[ 524.627811] env[67006]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 524.627811] env[67006]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 525.630316] env[67094]: /opt/stack/neutron/neutron/__init__.py:25: UserWarning: The selected oslo_service backend is "eventlet" [ 525.630316] env[67094]: warnings.warn('The selected oslo_service backend is "eventlet"') [ 527.461759] env[67094]: INFO neutron.common.config [-] Logging enabled! [ 527.462147] env[67094]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-nsxv3-agent version 28.0.0.0b2.dev40 [ 527.462306] env[67094]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-nsxv3-agent --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini --config-file /etc/neutron/plugins/ml2/ml2-nsxv3-1.ini {{(pid=67094) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} [ 527.462628] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] VMware NSXv3 Agent initializing ... [ 527.462715] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [-] Eventlet blocking behavior detection initialization completed. [ 527.463536] env[67094]: WARNING oslo_policy.policy [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 527.463748] env[67094]: WARNING oslo_policy.policy [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. [ 527.465419] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.agent [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] VMware NSXv3 Agent initialized successfully. [ 527.465766] env[67094]: DEBUG oslo_concurrency.lockutils [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] Acquiring lock "singleton_lock" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 527.465889] env[67094]: DEBUG oslo_concurrency.lockutils [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] Acquired lock "singleton_lock" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 527.466105] env[67094]: DEBUG oslo_concurrency.lockutils [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] Releasing lock "singleton_lock" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 527.466389] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] Full set of CONF: {{(pid=67094) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:275}} [ 527.466497] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] ******************************************************************************** {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}} [ 527.466597] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] Configuration options gathered from: {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}} [ 527.467246] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', '--config-file', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}} [ 527.467421] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}} [ 527.467529] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] ================================================================================ {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}} [ 527.467698] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] agent_down_time = 75 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.467835] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] allow_automatic_dhcp_failover = True {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.467967] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] allow_bulk = True {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.468121] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] api_extensions_path = {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.468258] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] api_paste_config = api-paste.ini {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.468397] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] auth_strategy = keystone {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.468498] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] backdoor_port = None {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.468597] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] backdoor_socket = None {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.468729] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] backlog = 4096 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.468861] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] base_mac = fa:16:3e:00:00:00 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.469020] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] bind_host = 0.0.0.0 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.469162] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] bind_port = 9696 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.469295] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] client_socket_timeout = 900 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.469431] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] config_dir = [] {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.469537] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini', '/etc/neutron/plugins/ml2/ml2-nsxv3-1.ini'] {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.469671] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] config_source = [] {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.469806] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] control_exchange = neutron {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.469943] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] core_plugin = ml2 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.470082] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] debug = True {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.470215] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] default_availability_zones = [] {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.470417] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.470550] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] dhcp_agent_notification = True {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.470681] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] dhcp_agents_per_network = 1 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.470943] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] dhcp_lease_duration = 86400 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.471123] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] dhcp_load_type = networks {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.471266] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] dns_domain = openstacklocal {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.471409] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.471537] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] enable_default_route_bfd = False {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.471665] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] enable_default_route_ecmp = False {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.471794] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] enable_dvr = True {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.471922] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] enable_new_agents = True {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.472062] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] enable_services_on_agents_with_admin_state_down = False {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.472192] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] enable_signals = True {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.472322] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] enable_traditional_dhcp = True {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.472448] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] external_dns_driver = None {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.472575] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] filter_validation = True {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.472713] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] global_physnet_mtu = 8950 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.472844] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] graceful_shutdown_timeout = 60 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.473039] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] host = cpu-1 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.473162] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] host_dvr_for_dhcp = True {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.473297] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] http_retries = 3 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.473433] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] instance_format = [instance: %(uuid)s] {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.473567] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.473701] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] ipam_driver = internal {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.473828] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] ipv6_pd_enabled = False {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.473953] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] l3_ha = False {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.474099] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.474231] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] l3_ha_network_physical_name = {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.474366] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] l3_ha_network_type = {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.474496] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] log_color = False {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.474626] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] log_config_append = None {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.474759] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.474887] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] log_dir = None {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.475023] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] log_file = None {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.475127] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] log_options = True {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.475260] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] log_rotate_interval = 1 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.475397] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] log_rotate_interval_type = days {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.475530] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] log_rotation_type = none {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.475633] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.475731] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.475862] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.475992] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.476106] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.476249] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] max_dns_nameservers = 5 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.476378] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] max_header_line = 16384 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.476507] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] max_l3_agents_per_router = 3 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.476635] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] max_logfile_count = 30 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.476760] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] max_logfile_size_mb = 200 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.476887] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] max_subnet_host_routes = 20 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.477031] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] my_ip = 10.180.1.21 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.477171] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] my_ipv6 = ::1 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.477300] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] network_auto_schedule = True {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.477421] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] network_link_prefix = None {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.477562] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.477698] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] notify_nova_on_port_data_changes = True {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.477826] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] notify_nova_on_port_status_changes = True {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.477958] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] pagination_max_limit = -1 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.478094] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] publish_errors = False {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.478223] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] rate_limit_burst = 0 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.478360] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] rate_limit_except_level = CRITICAL {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.478486] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] rate_limit_interval = 0 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.478611] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] retry_until_window = 30 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.478736] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] router_distributed = False {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.478864] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] rpc_resources_processing_step = 20 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.478989] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] rpc_response_max_timeout = 600 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.479132] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] rpc_response_timeout = 60 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.479262] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] send_events_interval = 2 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.479409] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] service_plugins = ['router'] {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.479545] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] setproctitle = on {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.479672] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] shell_completion = None {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.479805] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] state_path = /opt/stack/data/neutron {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.479937] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] syslog_log_facility = LOG_USER {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.480095] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] tcp_keepidle = 600 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.480238] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] transport_url = **** {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.480367] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] use_journal = False {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.480495] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] use_json = False {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.480623] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] use_ssl = False {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.480748] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] use_stderr = False {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.480877] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] use_syslog = False {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.481008] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] vlan_qinq = None {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.481139] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] vlan_transparent = None {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.481267] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] watch_log_file = False {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.481397] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] wsgi_default_pool_size = 100 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.481521] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] wsgi_keep_alive = True {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.481652] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.481779] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] wsgi_server_debug = False {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}} [ 527.481919] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] oslo_concurrency.disable_process_locking = False {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.482070] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.482214] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.482346] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.482482] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.482619] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.482755] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.482903] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] profiler.connection_string = messaging:// {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.483053] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] profiler.enabled = False {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.483195] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] profiler.es_doc_type = notification {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.483329] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] profiler.es_scroll_size = 10000 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.483464] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] profiler.es_scroll_time = 2m {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.483596] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] profiler.filter_error_trace = False {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.483735] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] profiler.hmac_keys = **** {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.483872] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] profiler.sentinel_service_name = mymaster {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.484026] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] profiler.socket_timeout = 0.1 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.484157] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] profiler.trace_requests = False {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.484290] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] profiler.trace_sqlalchemy = False {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.484433] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] profiler_jaeger.process_tags = {} {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.484567] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] profiler_jaeger.service_name_prefix = None {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.484694] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] profiler_otlp.service_name_prefix = None {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.484839] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] oslo_policy.enforce_new_defaults = True {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.485111] env[67094]: WARNING oslo_config.cfg [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. [ 527.485262] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] oslo_policy.enforce_scope = True {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.485406] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] oslo_policy.policy_default_rule = default {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.485552] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.485690] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.485831] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.485963] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.486101] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.486232] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.486363] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.486501] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] oslo_policy.remote_timeout = 60.0 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.486648] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.486790] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] agent.extensions = [] {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.486925] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.487074] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] service_providers.service_provider = [] {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.487222] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] QUOTAS.default_quota = -1 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.487363] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.487497] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] QUOTAS.quota_floatingip = 50 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.487627] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] QUOTAS.quota_network = 100 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.487828] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] QUOTAS.quota_port = 500 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.487967] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] QUOTAS.quota_rbac_policy = 10 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.488111] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] QUOTAS.quota_router = 10 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.488245] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] QUOTAS.quota_security_group = 10 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.488374] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] QUOTAS.quota_security_group_rule = 100 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.488504] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] QUOTAS.quota_subnet = 100 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.488630] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] QUOTAS.track_quota_usage = True {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.488771] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.488898] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] privsep.group = None {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.489029] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] privsep.helper_command = None {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.489159] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] privsep.log_daemon_traceback = False {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.489296] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] privsep.logger_name = oslo_privsep.daemon {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.489426] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] privsep.thread_pool_size = 8 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.489553] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] privsep.user = None {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.489688] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.489814] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] privsep_dhcp_release.group = None {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.489939] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] privsep_dhcp_release.helper_command = None {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.490074] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] privsep_dhcp_release.log_daemon_traceback = False {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.490209] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.490339] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] privsep_dhcp_release.thread_pool_size = 8 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.490465] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] privsep_dhcp_release.user = None {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.490595] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.490719] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] privsep_ovs_vsctl.group = None {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.490842] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] privsep_ovs_vsctl.helper_command = None {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.490967] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] privsep_ovs_vsctl.log_daemon_traceback = False {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.491110] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.491237] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] privsep_ovs_vsctl.thread_pool_size = 8 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.491363] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] privsep_ovs_vsctl.user = None {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.491495] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] privsep_namespace.capabilities = [21] {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.491619] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] privsep_namespace.group = None {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.491741] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] privsep_namespace.helper_command = None {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.491867] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] privsep_namespace.log_daemon_traceback = False {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.491997] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.492135] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] privsep_namespace.thread_pool_size = 8 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.492262] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] privsep_namespace.user = None {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.492395] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] privsep_conntrack.capabilities = [12] {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.492517] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] privsep_conntrack.group = None {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.492639] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] privsep_conntrack.helper_command = None {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.492763] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] privsep_conntrack.log_daemon_traceback = False {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.492892] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.493027] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] privsep_conntrack.thread_pool_size = 8 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.493152] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] privsep_conntrack.user = None {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.493288] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] privsep_link.capabilities = [12, 21] {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.493412] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] privsep_link.group = None {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.493532] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] privsep_link.helper_command = None {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.493656] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] privsep_link.log_daemon_traceback = False {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.493784] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.493912] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] privsep_link.thread_pool_size = 8 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.494044] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] privsep_link.user = None {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.494193] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] AGENT.agent_id = nsxm-l-01a.corp.local {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.494337] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] AGENT.agent_prometheus_exporter_port = 8000 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.494469] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] AGENT.continue_on_failed_promotions = False {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.494596] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] AGENT.dscp = None {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.494726] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] AGENT.dscp_inherit = False {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.494863] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] AGENT.force_mp_to_policy = True {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.494987] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] AGENT.locking_coordinator_url = None {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.495128] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] AGENT.log_agent_heartbeats = False {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.495260] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] AGENT.logging_expire = 1 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.495397] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] AGENT.logging_url = unix:///var/run/redis/socket/redis.sock {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.495527] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] AGENT.max_sg_tags_per_segment_port = 27 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.495666] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] AGENT.polling_interval = 240 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.495795] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] AGENT.ports_tag_number_decrease_workaround = True {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.495932] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] AGENT.quitting_rpc_timeout = 120 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.496082] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] AGENT.report_interval = 30.0 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.496232] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.496370] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.496507] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] AGENT.rpc_max_records_per_query = 1000 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.496640] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] AGENT.sync_skew = 60 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.496770] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] AGENT.synchronization_queue_size = 20 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.496898] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] AGENT.use_helper_for_ns_read = True {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.497041] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] SECURITYGROUP.enable_ipset = True {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.497180] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] SECURITYGROUP.enable_security_group = True {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.497317] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] SECURITYGROUP.firewall_driver = nsxv3 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.497451] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.497585] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] experimental.ipv6_pd_enabled = False {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.497738] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] ml2.extension_drivers = ['port_security'] {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.497866] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] ml2.external_network_type = None {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.498013] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] ml2.mechanism_drivers = ['nsxv3', 'openvswitch', 'logger'] {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.498156] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] ml2.overlay_ip_version = 4 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.498294] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] ml2.path_mtu = 8950 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.498429] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] ml2.physical_network_mtus = {} {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.498570] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] ml2.tenant_network_types = ['vlan'] {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.498706] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.498845] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] ml2.type_drivers = ['vlan'] {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.498982] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] AGENT_CLI.neutron_port_id = [] {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.499125] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] AGENT_CLI.neutron_qos_policy_id = [] {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.499252] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] AGENT_CLI.neutron_security_group_id = [] {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.499392] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] NSXV3.nsxv3_concurrent_requests = 40 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.499532] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] NSXV3.nsxv3_connection_retry_count = 2 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.499666] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] NSXV3.nsxv3_connection_retry_sleep = 2 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.499799] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] NSXV3.nsxv3_default_policy_infrastructure_rules = True {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.499936] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] NSXV3.nsxv3_dfw_connectivity_strategy = NONE {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.500083] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] NSXV3.nsxv3_ip_discovery_switching_profile = nsx-default-ip-discovery-vlan-profile {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.500276] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] NSXV3.nsxv3_login_hostname = nsxt.osci.c.eu-de-1.cloud.sap {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.500421] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] NSXV3.nsxv3_login_password = **** {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.500562] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] NSXV3.nsxv3_login_port = 443 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.500697] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] NSXV3.nsxv3_login_user = admin {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.500829] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] NSXV3.nsxv3_managed_hosts = [] {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.500967] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] NSXV3.nsxv3_max_records_per_query = 200 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.501111] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] NSXV3.nsxv3_operation_retry_count = 3 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.501241] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] NSXV3.nsxv3_operation_retry_sleep = 5 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.501378] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] NSXV3.nsxv3_realization_timeout = 300 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.501517] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] NSXV3.nsxv3_remove_orphan_ports_after = 2.0 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.501652] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] NSXV3.nsxv3_request_timeout = 60 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.501788] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] NSXV3.nsxv3_requests_per_second = 80 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.501920] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] NSXV3.nsxv3_requests_per_second_timeout = 7 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.502071] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] NSXV3.nsxv3_spoof_guard_switching_profile = nsx-default-spoof-guard-vif-profile {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.502213] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] NSXV3.nsxv3_suppress_ssl_warnings = True {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.502348] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] NSXV3.nsxv3_transport_zone_id_cache_time = 86400 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.502485] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] NSXV3.nsxv3_transport_zone_name = nsx-vlan-transportzone {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.502668] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] vsphere.vsphere_login_hostname = vc-l-01a.corp.local {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.502809] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] vsphere.vsphere_login_password = VMware1! {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.502945] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] vsphere.vsphere_login_username = administrator@vsphere.local {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.503088] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] vsphere.vsphere_suppress_ssl_wornings = True {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.503226] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] nova.auth_section = None {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.503368] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] nova.auth_type = password {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.503506] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.503633] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] nova.certfile = None {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.503767] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] nova.collect_timing = False {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.503908] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] nova.endpoint_type = public {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.504052] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] nova.insecure = False {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.504181] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] nova.keyfile = None {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.504321] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] nova.region_name = RegionOne {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.504455] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] nova.split_loggers = False {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.504585] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] nova.timeout = None {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.504721] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] placement.auth_section = None {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.504860] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] placement.auth_type = password {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.504994] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.505133] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] placement.certfile = None {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.505264] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] placement.collect_timing = False {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.505398] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] placement.endpoint_type = public {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.505526] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] placement.insecure = False {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.505652] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] placement.keyfile = None {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.505776] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] placement.region_name = None {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.505905] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] placement.split_loggers = False {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.506046] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] placement.timeout = None {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.506201] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] ironic.auth_section = None {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.506316] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] ironic.auth_type = None {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.506442] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] ironic.cafile = None {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.506567] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] ironic.certfile = None {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.506698] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] ironic.collect_timing = False {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.506824] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] ironic.connect_retries = None {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.506951] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] ironic.connect_retry_delay = None {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.507091] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] ironic.enable_notifications = False {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.507250] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] ironic.endpoint_override = None {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.507352] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] ironic.insecure = False {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.507474] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] ironic.interface = None {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.507597] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] ironic.keyfile = None {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.507727] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] ironic.max_version = None {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.507853] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] ironic.min_version = None {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.507976] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] ironic.region_name = None {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.508111] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] ironic.retriable_status_codes = None {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.508236] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] ironic.service_name = None {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.508359] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] ironic.service_type = None {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.508681] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] ironic.split_loggers = False {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.508681] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] ironic.status_code_retries = None {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.508735] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] ironic.status_code_retry_delay = None {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.508871] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] ironic.timeout = None {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.508951] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] ironic.valid_interfaces = None {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.509085] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] ironic.version = None {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.509221] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] cli_script.dry_run = False {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.509351] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.509480] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.509610] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.509738] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.509864] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.509988] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.510126] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.510255] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.510387] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.510527] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.510658] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.510794] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.510931] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.511074] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.511240] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.511351] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] oslo_messaging_rabbit.processname = neutron-nsxv3-agent {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.511483] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.511612] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.511748] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.511880] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.512026] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.512154] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.512284] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.512412] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.512541] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.512669] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.512796] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.512923] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.513061] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.513191] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.513322] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] oslo_messaging_rabbit.ssl = False {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.513457] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.513591] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.513720] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.513857] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.513991] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] oslo_messaging_rabbit.ssl_version = {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.514134] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.514273] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] oslo_messaging_notifications.driver = [] {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.514404] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] oslo_messaging_notifications.retry = -1 {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.514545] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.514672] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] oslo_messaging_notifications.transport_url = **** {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}} [ 527.514774] env[67094]: DEBUG oslo_service.backend._eventlet.service [None req-f12f0ae0-5565-4a79-9b7a-646aa2b20639 None None] ******************************************************************************** {{(pid=67094) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}} [ 527.515895] env[67094]: DEBUG neutron.agent.securitygroups_rpc [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] Init firewall settings (driver=nsxv3) {{(pid=67094) init_firewall /opt/stack/neutron/neutron/agent/securitygroups_rpc.py:137}} [ 527.517185] env[67094]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.extensions.firewall [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] Initializing NSXv3SecurityGroupsDriver dummy driver. {{(pid=67094) __init__ /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/extensions/firewall.py:16}} [ 527.517418] env[67094]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] RPC agent_id: nsxm-l-01a.corp.local [ 527.519626] env[67094]: DEBUG dogpile.cache.region [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 527.519752] env[67094]: DEBUG dogpile.lock [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 527.519852] env[67094]: DEBUG dogpile.lock [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 527.519943] env[67094]: DEBUG dogpile.lock [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 527.520048] env[67094]: DEBUG dogpile.cache.region [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 527.520138] env[67094]: DEBUG dogpile.lock [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 527.520259] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 527.558815] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] Session token - acquiring [ 527.560409] env[67094]: DEBUG networking_nsxv3.common.locking [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] Lock https://nsxt.osci.c.eu-de-1.cloud.sap:443 taken with stack trace [, , , , , , , , , , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 527.560586] env[67094]: DEBUG oslo_concurrency.lockutils [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] Acquiring lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 527.560686] env[67094]: DEBUG oslo_concurrency.lockutils [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] Acquired lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 527.561157] env[67094]: DEBUG oslo_concurrency.lockutils [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] Acquired external semaphore "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 527.572153] env[67094]: DEBUG oslo_concurrency.lockutils [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] Releasing lock "https://nsxt.osci.c.eu-de-1.cloud.sap:443" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 527.848885] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] Session token - acquired, connected to NSX-T 4.1.2.0.0.22589037 [ 527.880808] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 527.881026] env[67094]: DEBUG dogpile.cache.region [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] Cache value generated in 0.361 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 527.881026] env[67094]: DEBUG dogpile.lock [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 527.881129] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] Activating Policy API Provider. [ 527.881406] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] Looking for the default Infrastructure Rules. [ 527.977137] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] Looking for the Default Layer3 Logged Drop Section. [ 527.992842] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] Detected NSX-T (4, 1, 2, 0, 0, 22589037) version. [ 527.993344] env[67094]: DEBUG networking_nsxv3.common.locking [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] Lock all taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 527.993516] env[67094]: DEBUG oslo_concurrency.lockutils [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] Acquiring lock "all" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 527.993618] env[67094]: DEBUG oslo_concurrency.lockutils [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] Acquired lock "all" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 527.993904] env[67094]: DEBUG oslo_concurrency.lockutils [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] Acquired external semaphore "all" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 527.994336] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 528.510785] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 529.013040] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 529.515823] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] Inventory metadata is going to be refreshed. [ 529.516325] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 530.376526] env[67094]: DEBUG networking_nsxv3.common.locking [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] Lock Segment taken with stack trace [, , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 530.376920] env[67094]: DEBUG oslo_concurrency.lockutils [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 530.376920] env[67094]: DEBUG oslo_concurrency.lockutils [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 530.377169] env[67094]: DEBUG oslo_concurrency.lockutils [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 530.387844] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 530.388851] env[67094]: DEBUG oslo_concurrency.lockutils [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 530.389853] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 530.410637] env[67094]: DEBUG networking_nsxv3.common.locking [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 530.410906] env[67094]: DEBUG oslo_concurrency.lockutils [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 530.410906] env[67094]: DEBUG oslo_concurrency.lockutils [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 530.411218] env[67094]: DEBUG oslo_concurrency.lockutils [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 530.411342] env[67094]: DEBUG oslo_concurrency.lockutils [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 530.411487] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 530.411627] env[67094]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] Outdated resources of Type:SegmentPort Are:set() {{(pid=67094) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 530.411786] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 530.432304] env[67094]: DEBUG networking_nsxv3.common.locking [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] Lock Security Group (Rules) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 530.432565] env[67094]: DEBUG oslo_concurrency.lockutils [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 530.432640] env[67094]: DEBUG oslo_concurrency.lockutils [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 530.432880] env[67094]: DEBUG oslo_concurrency.lockutils [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 530.433063] env[67094]: DEBUG oslo_concurrency.lockutils [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 530.433207] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 530.454009] env[67094]: DEBUG networking_nsxv3.common.locking [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 530.454309] env[67094]: DEBUG oslo_concurrency.lockutils [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 530.454309] env[67094]: DEBUG oslo_concurrency.lockutils [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 530.454614] env[67094]: DEBUG oslo_concurrency.lockutils [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 530.454762] env[67094]: DEBUG oslo_concurrency.lockutils [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 530.454905] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 530.476027] env[67094]: DEBUG networking_nsxv3.common.locking [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] Lock Address Group taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 530.476467] env[67094]: DEBUG oslo_concurrency.lockutils [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] Acquiring lock "Address Group" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 530.476467] env[67094]: DEBUG oslo_concurrency.lockutils [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] Acquired lock "Address Group" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 530.476678] env[67094]: DEBUG oslo_concurrency.lockutils [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] Acquired external semaphore "Address Group" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 530.476817] env[67094]: DEBUG oslo_concurrency.lockutils [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] Releasing lock "Address Group" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 530.476966] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 530.477078] env[67094]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=67094) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 530.477210] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 530.495934] env[67094]: DEBUG networking_nsxv3.common.locking [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] Lock Segment QoS taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 530.496169] env[67094]: DEBUG oslo_concurrency.lockutils [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] Acquiring lock "Segment QoS" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 530.496274] env[67094]: DEBUG oslo_concurrency.lockutils [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] Acquired lock "Segment QoS" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 530.496587] env[67094]: DEBUG oslo_concurrency.lockutils [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] Acquired external semaphore "Segment QoS" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 530.496666] env[67094]: DEBUG oslo_concurrency.lockutils [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] Releasing lock "Segment QoS" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 530.496807] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 530.496906] env[67094]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] Outdated resources of Type:Segment QoS Are:set() {{(pid=67094) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 530.497022] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 530.536694] env[67094]: DEBUG networking_nsxv3.common.locking [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] Lock Security Group (Members) taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 530.537279] env[67094]: DEBUG oslo_concurrency.lockutils [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 530.537279] env[67094]: DEBUG oslo_concurrency.lockutils [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 530.537352] env[67094]: DEBUG oslo_concurrency.lockutils [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 530.537500] env[67094]: DEBUG oslo_concurrency.lockutils [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 530.537640] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 530.537745] env[67094]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=67094) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 530.537843] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] Inventory metadata have been refreshed. [ 530.537925] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] Dryrun:True. Metadata refresh completed. [ 530.538058] env[67094]: DEBUG oslo_concurrency.lockutils [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] Releasing lock "all" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 530.539722] env[67094]: INFO neutron.agent.agent_extensions_manager [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] Loaded agent extensions: [] [ 530.540491] env[67094]: DEBUG neutron_lib.callbacks.manager [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] Publish callbacks [] for NSXv3 Agent (None), after_init {{(pid=67094) _notify_loop /opt/stack/data/venv/lib/python3.10/site-packages/neutron_lib/callbacks/manager.py:184}} [ 530.603420] env[67094]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] NSXv3 Agent Agent RPC Daemon Started! [ 530.603609] env[67094]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] NSXv3 Agent Agent loop - iteration:0 started [ 530.603651] env[67094]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] NSXv3 Agent Agent out of sync with plugin! [ 535.540672] env[67094]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 535.540994] env[67094]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 540.541489] env[67094]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 540.541866] env[67094]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 545.400710] env[67094]: INFO networking_nsxv3.common.synchronization [None req-decd7fc2-c255-4ef6-88d2-b795b1569296 demo admin] Enqueued Resource ID: 2b6b7ade-6de7-4a11-9a68-c4b71d97d61c with Priority: HIGHEST for action security_group_rules [ 545.401417] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2b6b7ade-6de7-4a11-9a68-c4b71d97d61c with Priority: HIGHEST for action security_group_rules [ 545.401638] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2b6b7ade-6de7-4a11-9a68-c4b71d97d61c taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 545.401768] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2b6b7ade-6de7-4a11-9a68-c4b71d97d61c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 545.401849] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2b6b7ade-6de7-4a11-9a68-c4b71d97d61c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 545.402211] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2b6b7ade-6de7-4a11-9a68-c4b71d97d61c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 545.402296] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2b6b7ade-6de7-4a11-9a68-c4b71d97d61c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 545.543150] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 545.543362] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 545.543362] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 545.543553] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 545.543782] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 545.925437] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 545.925644] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 545.925644] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 545.925780] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 545.925878] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 545.925970] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2b6b7ade-6de7-4a11-9a68-c4b71d97d61c already deleted. [ 545.926062] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2b6b7ade-6de7-4a11-9a68-c4b71d97d61c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 546.045938] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 546.548090] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 547.050781] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 547.050979] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 547.772845] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.773300] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.773300] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 547.773300] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 547.785144] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 547.785933] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 547.786649] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 547.805141] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.805360] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.805360] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 547.805542] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 547.805613] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 547.805722] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 547.805789] env[67094]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=67094) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 547.805861] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 547.826323] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.826614] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.826614] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 547.826748] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 547.826853] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 547.826962] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 547.845285] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.845484] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.845484] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 547.845651] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 547.845750] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 547.845855] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 547.863957] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.864178] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.864178] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 547.864355] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 547.864444] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 547.864570] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:0. [ 547.864647] env[67094]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:set() {{(pid=67094) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 547.864710] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 547.880836] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.881115] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.881115] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 547.881270] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 547.881322] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 547.881425] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 547.881511] env[67094]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=67094) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 547.881567] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 547.900734] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.900936] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.900936] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 547.901116] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 547.901222] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 547.901333] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 547.901407] env[67094]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=67094) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 547.901466] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 547.901532] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 547.901602] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Rules [ 547.901660] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Security Group Members [ 547.901710] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:QoS [ 547.901970] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Items outdated since last Agent sanitize:0 [ 547.902047] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Sanitizing provider based on age cycles [ 547.902114] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 547.920288] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.920530] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.920530] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 547.920711] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 547.920836] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 547.920944] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 547.939080] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 547.939321] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 547.939321] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 547.939493] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 547.939554] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 547.976722] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 550.402873] env[67094]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 550.403258] env[67094]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 555.404418] env[67094]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 555.404418] env[67094]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 560.405485] env[67094]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 560.405855] env[67094]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 565.407039] env[67094]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 565.407545] env[67094]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 570.409017] env[67094]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 570.409416] env[67094]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 575.296410] env[67094]: INFO networking_nsxv3.common.synchronization [None req-363cdcd8-be7c-435b-97c3-b9722874833c None None] Enqueued Resource ID: 61a995db-7b87-4f72-9069-5d904ac9ce81 with Priority: HIGHEST for action port [ 575.298038] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 61a995db-7b87-4f72-9069-5d904ac9ce81 with Priority: HIGHEST for action port [ 575.298113] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-61a995db-7b87-4f72-9069-5d904ac9ce81 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.298229] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-61a995db-7b87-4f72-9069-5d904ac9ce81" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.298294] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-61a995db-7b87-4f72-9069-5d904ac9ce81" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.298549] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-61a995db-7b87-4f72-9069-5d904ac9ce81" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.298631] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('61a995db-7b87-4f72-9069-5d904ac9ce81',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 575.801212] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 61a995db-7b87-4f72-9069-5d904ac9ce81 [ 575.801454] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 575.801593] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 575.801662] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 575.801882] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 575.801967] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 575.802073] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:61a995db-7b87-4f72-9069-5d904ac9ce81 already deleted. [ 575.802155] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-61a995db-7b87-4f72-9069-5d904ac9ce81" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.380876] env[67094]: INFO networking_nsxv3.common.synchronization [None req-691aaed5-8921-400f-bbe7-7f6ced293c02 None None] Enqueued Resource ID: 6ef46756-2c90-4cd4-b39e-7799bb767137 with Priority: HIGHEST for action port [ 576.381152] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ef46756-2c90-4cd4-b39e-7799bb767137 with Priority: HIGHEST for action port [ 576.381681] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ef46756-2c90-4cd4-b39e-7799bb767137 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.381838] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ef46756-2c90-4cd4-b39e-7799bb767137" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.381870] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ef46756-2c90-4cd4-b39e-7799bb767137" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.382670] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ef46756-2c90-4cd4-b39e-7799bb767137" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.382760] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ef46756-2c90-4cd4-b39e-7799bb767137',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 576.887443] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6ef46756-2c90-4cd4-b39e-7799bb767137 [ 576.887966] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 576.887966] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 576.887966] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 576.888108] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 576.888245] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 576.888304] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6ef46756-2c90-4cd4-b39e-7799bb767137 already deleted. [ 576.888339] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ef46756-2c90-4cd4-b39e-7799bb767137" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.088081] env[67094]: INFO networking_nsxv3.common.synchronization [None req-8ecbdd79-5567-4019-86d8-fa73daed4389 None None] Enqueued Resource ID: a107d28d-1fb9-4fe0-a339-5ef1d396b7a0 with Priority: HIGHEST for action port [ 577.088635] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a107d28d-1fb9-4fe0-a339-5ef1d396b7a0 with Priority: HIGHEST for action port [ 577.088963] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-a107d28d-1fb9-4fe0-a339-5ef1d396b7a0 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.089111] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a107d28d-1fb9-4fe0-a339-5ef1d396b7a0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.089186] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a107d28d-1fb9-4fe0-a339-5ef1d396b7a0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.089420] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a107d28d-1fb9-4fe0-a339-5ef1d396b7a0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.089670] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a107d28d-1fb9-4fe0-a339-5ef1d396b7a0',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 577.540597] env[67094]: INFO networking_nsxv3.common.synchronization [None req-28f55a19-fcd8-432e-972b-e44b50bf25d4 None None] Enqueued Resource ID: 959f3891-636a-427f-bd40-afd53b7e2684 with Priority: HIGHEST for action port [ 577.541413] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 959f3891-636a-427f-bd40-afd53b7e2684 with Priority: HIGHEST for action port [ 577.541652] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-959f3891-636a-427f-bd40-afd53b7e2684 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.541825] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-959f3891-636a-427f-bd40-afd53b7e2684" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.541908] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-959f3891-636a-427f-bd40-afd53b7e2684" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.542161] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-959f3891-636a-427f-bd40-afd53b7e2684" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.542212] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('959f3891-636a-427f-bd40-afd53b7e2684',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 577.594199] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a107d28d-1fb9-4fe0-a339-5ef1d396b7a0 [ 577.594859] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 577.594859] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 577.594859] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 577.595077] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 577.595077] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 577.595508] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a107d28d-1fb9-4fe0-a339-5ef1d396b7a0 already deleted. [ 577.595662] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a107d28d-1fb9-4fe0-a339-5ef1d396b7a0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.044302] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 959f3891-636a-427f-bd40-afd53b7e2684 [ 578.044649] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.044809] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.044879] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.045096] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.045181] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.045272] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:959f3891-636a-427f-bd40-afd53b7e2684 already deleted. [ 578.045351] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-959f3891-636a-427f-bd40-afd53b7e2684" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.195541] env[67094]: INFO networking_nsxv3.common.synchronization [None req-1e2ca82a-7fc0-426f-83c8-28f64c529dcc None None] Enqueued Resource ID: adb67f95-4cc6-4397-8e83-bc6d494a0d6f with Priority: HIGHEST for action port [ 578.196145] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: adb67f95-4cc6-4397-8e83-bc6d494a0d6f with Priority: HIGHEST for action port [ 578.196507] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-adb67f95-4cc6-4397-8e83-bc6d494a0d6f taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.196660] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-adb67f95-4cc6-4397-8e83-bc6d494a0d6f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.196729] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-adb67f95-4cc6-4397-8e83-bc6d494a0d6f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.196976] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-adb67f95-4cc6-4397-8e83-bc6d494a0d6f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.197076] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('adb67f95-4cc6-4397-8e83-bc6d494a0d6f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 578.700093] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port adb67f95-4cc6-4397-8e83-bc6d494a0d6f [ 578.701146] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 578.701146] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 578.701146] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 578.701949] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 578.703102] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 578.703102] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:adb67f95-4cc6-4397-8e83-bc6d494a0d6f already deleted. [ 578.703102] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-adb67f95-4cc6-4397-8e83-bc6d494a0d6f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 579.905430] env[67094]: INFO networking_nsxv3.common.synchronization [None req-0eb14433-33cb-40c3-ae1a-314805235115 None None] Enqueued Resource ID: a723c522-ce45-47cb-9bbe-129759069409 with Priority: HIGHEST for action port [ 579.906136] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a723c522-ce45-47cb-9bbe-129759069409 with Priority: HIGHEST for action port [ 579.906286] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-a723c522-ce45-47cb-9bbe-129759069409 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 579.907473] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a723c522-ce45-47cb-9bbe-129759069409" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 579.907473] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a723c522-ce45-47cb-9bbe-129759069409" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 579.907473] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a723c522-ce45-47cb-9bbe-129759069409" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 579.907473] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a723c522-ce45-47cb-9bbe-129759069409',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.009138] env[67094]: INFO networking_nsxv3.common.synchronization [None req-e9d497a3-58e5-4778-8909-4b3000637a1a None None] Enqueued Resource ID: 0b37bb24-8d42-4fc4-9fca-518ea4403771 with Priority: HIGHEST for action port [ 580.009138] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0b37bb24-8d42-4fc4-9fca-518ea4403771 with Priority: HIGHEST for action port [ 580.009138] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-0b37bb24-8d42-4fc4-9fca-518ea4403771 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.009138] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0b37bb24-8d42-4fc4-9fca-518ea4403771" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.009138] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0b37bb24-8d42-4fc4-9fca-518ea4403771" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.009532] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0b37bb24-8d42-4fc4-9fca-518ea4403771" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.009754] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0b37bb24-8d42-4fc4-9fca-518ea4403771',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 580.409562] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a723c522-ce45-47cb-9bbe-129759069409 [ 580.409822] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.409960] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.410045] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.410464] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.410559] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.410704] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a723c522-ce45-47cb-9bbe-129759069409 already deleted. [ 580.410798] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a723c522-ce45-47cb-9bbe-129759069409" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.512355] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0b37bb24-8d42-4fc4-9fca-518ea4403771 [ 580.512676] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 580.513260] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 580.513516] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 580.513764] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 580.514107] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 580.514107] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0b37bb24-8d42-4fc4-9fca-518ea4403771 already deleted. [ 580.514218] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0b37bb24-8d42-4fc4-9fca-518ea4403771" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.146167] env[67094]: INFO networking_nsxv3.common.synchronization [None req-474a7046-ecfc-4150-9d52-1c8637115a12 None None] Enqueued Resource ID: dee39a71-2466-4556-a77f-55fed07bd21e with Priority: HIGHEST for action port [ 582.146406] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dee39a71-2466-4556-a77f-55fed07bd21e with Priority: HIGHEST for action port [ 582.146958] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-dee39a71-2466-4556-a77f-55fed07bd21e taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.147093] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dee39a71-2466-4556-a77f-55fed07bd21e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.147133] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dee39a71-2466-4556-a77f-55fed07bd21e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.147975] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dee39a71-2466-4556-a77f-55fed07bd21e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.147975] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dee39a71-2466-4556-a77f-55fed07bd21e',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.452475] env[67094]: INFO networking_nsxv3.common.synchronization [None req-1ed4c06f-e782-4e7a-9039-03f47b0da8c3 None None] Enqueued Resource ID: b211364b-f6bd-4af4-b75b-92e48384e7e3 with Priority: HIGHEST for action port [ 582.452475] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b211364b-f6bd-4af4-b75b-92e48384e7e3 with Priority: HIGHEST for action port [ 582.452475] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-b211364b-f6bd-4af4-b75b-92e48384e7e3 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.452475] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b211364b-f6bd-4af4-b75b-92e48384e7e3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.452475] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b211364b-f6bd-4af4-b75b-92e48384e7e3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.452475] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b211364b-f6bd-4af4-b75b-92e48384e7e3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.452475] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b211364b-f6bd-4af4-b75b-92e48384e7e3',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.653874] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dee39a71-2466-4556-a77f-55fed07bd21e [ 582.653874] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.653874] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.653874] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.653874] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.653874] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.653874] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dee39a71-2466-4556-a77f-55fed07bd21e already deleted. [ 582.653874] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dee39a71-2466-4556-a77f-55fed07bd21e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.799663] env[67094]: INFO networking_nsxv3.common.synchronization [None req-714a71ad-c0d8-40c5-8c11-d23549a945b6 tempest-ServersTestFqdnHostnames-1054617166 tempest-ServersTestFqdnHostnames-1054617166-project-member] Enqueued Resource ID: 0c6a3072-604c-444a-b4d4-9ed06e060bef with Priority: HIGHEST for action security_group_rules [ 582.800424] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c6a3072-604c-444a-b4d4-9ed06e060bef with Priority: HIGHEST for action security_group_rules [ 582.800838] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c6a3072-604c-444a-b4d4-9ed06e060bef taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.801122] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c6a3072-604c-444a-b4d4-9ed06e060bef" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.801269] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c6a3072-604c-444a-b4d4-9ed06e060bef" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.801713] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c6a3072-604c-444a-b4d4-9ed06e060bef" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.802043] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c6a3072-604c-444a-b4d4-9ed06e060bef',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.870027] env[67094]: INFO networking_nsxv3.common.synchronization [None req-6389975e-6b86-47e4-a8b6-5cee16d8d72f None None] Enqueued Resource ID: 5b050e24-620e-4240-bf4a-6b4b278dc7df with Priority: HIGHEST for action port [ 582.870556] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5b050e24-620e-4240-bf4a-6b4b278dc7df with Priority: HIGHEST for action port [ 582.870909] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-5b050e24-620e-4240-bf4a-6b4b278dc7df taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.871064] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5b050e24-620e-4240-bf4a-6b4b278dc7df" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.871273] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5b050e24-620e-4240-bf4a-6b4b278dc7df" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.871335] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5b050e24-620e-4240-bf4a-6b4b278dc7df" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.871413] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5b050e24-620e-4240-bf4a-6b4b278dc7df',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 582.955986] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b211364b-f6bd-4af4-b75b-92e48384e7e3 [ 582.955986] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.955986] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 582.956234] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 582.956270] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 582.956335] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.956433] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b211364b-f6bd-4af4-b75b-92e48384e7e3 already deleted. [ 582.956534] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b211364b-f6bd-4af4-b75b-92e48384e7e3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 582.977704] env[67094]: INFO networking_nsxv3.common.synchronization [None req-1f3a4548-65bc-49a3-8213-a93a507f5399 tempest-ServersTestFqdnHostnames-1054617166 tempest-ServersTestFqdnHostnames-1054617166-project-member] Enqueued Resource ID: 0c6a3072-604c-444a-b4d4-9ed06e060bef with Priority: HIGHEST for action security_group_rules [ 582.978902] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c6a3072-604c-444a-b4d4-9ed06e060bef with Priority: HIGHEST for action security_group_rules [ 582.979268] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c6a3072-604c-444a-b4d4-9ed06e060bef taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 582.979376] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c6a3072-604c-444a-b4d4-9ed06e060bef" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.328410] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.328732] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.328732] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.328843] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.328942] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.329076] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c6a3072-604c-444a-b4d4-9ed06e060bef already deleted. [ 583.329172] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c6a3072-604c-444a-b4d4-9ed06e060bef" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.329327] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c6a3072-604c-444a-b4d4-9ed06e060bef" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.329493] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c6a3072-604c-444a-b4d4-9ed06e060bef" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.329574] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c6a3072-604c-444a-b4d4-9ed06e060bef',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 583.373914] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5b050e24-620e-4240-bf4a-6b4b278dc7df [ 583.374163] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.374291] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.374357] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.374559] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.374646] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.374738] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5b050e24-620e-4240-bf4a-6b4b278dc7df already deleted. [ 583.374817] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5b050e24-620e-4240-bf4a-6b4b278dc7df" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.854230] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 583.854230] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 583.854230] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 583.854403] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 583.854522] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 583.854581] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c6a3072-604c-444a-b4d4-9ed06e060bef already deleted. [ 583.854920] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c6a3072-604c-444a-b4d4-9ed06e060bef" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.290875] env[67094]: INFO networking_nsxv3.common.synchronization [None req-ad55dc5c-a5cc-44d2-a421-26a96d64f05a None None] Enqueued Resource ID: b70c329a-88ca-4070-8d73-046e9098849d with Priority: HIGHEST for action port [ 584.291773] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b70c329a-88ca-4070-8d73-046e9098849d with Priority: HIGHEST for action port [ 584.291773] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-b70c329a-88ca-4070-8d73-046e9098849d taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.291918] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b70c329a-88ca-4070-8d73-046e9098849d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.291956] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b70c329a-88ca-4070-8d73-046e9098849d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.293046] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b70c329a-88ca-4070-8d73-046e9098849d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.293046] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b70c329a-88ca-4070-8d73-046e9098849d',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.725316] env[67094]: INFO networking_nsxv3.common.synchronization [None req-4ff08c5b-3b67-4a4e-8acb-ef1330192033 None None] Enqueued Resource ID: 20ed7f68-7a9c-4bd5-aa56-cb7591941a59 with Priority: HIGHEST for action port [ 584.725877] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 20ed7f68-7a9c-4bd5-aa56-cb7591941a59 with Priority: HIGHEST for action port [ 584.726196] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-20ed7f68-7a9c-4bd5-aa56-cb7591941a59 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.726320] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-20ed7f68-7a9c-4bd5-aa56-cb7591941a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.726629] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-20ed7f68-7a9c-4bd5-aa56-cb7591941a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.726709] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-20ed7f68-7a9c-4bd5-aa56-cb7591941a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.726747] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('20ed7f68-7a9c-4bd5-aa56-cb7591941a59',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 584.796862] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b70c329a-88ca-4070-8d73-046e9098849d [ 584.798464] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 584.798464] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 584.798464] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 584.798464] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 584.798464] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 584.798464] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b70c329a-88ca-4070-8d73-046e9098849d already deleted. [ 584.798464] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b70c329a-88ca-4070-8d73-046e9098849d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.230423] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 20ed7f68-7a9c-4bd5-aa56-cb7591941a59 [ 585.230988] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.232795] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.232795] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.232795] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.232795] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.232795] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:20ed7f68-7a9c-4bd5-aa56-cb7591941a59 already deleted. [ 585.232795] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-20ed7f68-7a9c-4bd5-aa56-cb7591941a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.351492] env[67094]: INFO networking_nsxv3.common.synchronization [req-7934573a-dc78-4664-b7dd-991eec4fdbc1 req-cdd79f91-73e5-4fbc-b943-97a7e9e80ad9 tempest-TenantUsagesTestJSON-1786793036 tempest-TenantUsagesTestJSON-1786793036-project-member] Enqueued Resource ID: cb367675-42aa-4b50-8812-8a73fdef747d with Priority: HIGHEST for action security_group_members [ 585.351820] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb367675-42aa-4b50-8812-8a73fdef747d with Priority: HIGHEST for action security_group_members [ 585.352131] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb367675-42aa-4b50-8812-8a73fdef747d taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.352256] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb367675-42aa-4b50-8812-8a73fdef747d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.352327] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb367675-42aa-4b50-8812-8a73fdef747d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.352574] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb367675-42aa-4b50-8812-8a73fdef747d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.352729] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.352827] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.352938] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.353497] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.353497] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.353497] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb367675-42aa-4b50-8812-8a73fdef747d',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.830159] env[67094]: INFO networking_nsxv3.common.synchronization [None req-87b4f31c-4da7-496f-8cb4-93ba8bf10b72 None None] Enqueued Resource ID: 201a25d1-d0dd-4929-b381-6fb228669b8b with Priority: HIGHEST for action port [ 585.830603] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 201a25d1-d0dd-4929-b381-6fb228669b8b with Priority: HIGHEST for action port [ 585.830898] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-201a25d1-d0dd-4929-b381-6fb228669b8b taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.830987] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-201a25d1-d0dd-4929-b381-6fb228669b8b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.831614] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-201a25d1-d0dd-4929-b381-6fb228669b8b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.831879] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-201a25d1-d0dd-4929-b381-6fb228669b8b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.831968] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('201a25d1-d0dd-4929-b381-6fb228669b8b',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 585.856714] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.857214] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.857407] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.859259] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.859259] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.859259] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 585.859259] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 585.859259] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 585.859259] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 585.859259] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 585.859259] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb367675-42aa-4b50-8812-8a73fdef747d already deleted. [ 585.859259] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb367675-42aa-4b50-8812-8a73fdef747d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.291153] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock network-653 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.291153] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "network-653" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.291153] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "network-653" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.291153] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "network-653" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.291343] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.291550] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.291681] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.291910] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.292451] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.292451] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 586.293094] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 586.294981] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 586.294981] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 586.294981] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 586.294981] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 586.294981] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 586.317864] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 586.318041] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 586.318178] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 586.318354] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "network-653" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.321782] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock port-12a33f3b-4ec4-4e29-aab2-a5aae73f221b taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.321782] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "port-12a33f3b-4ec4-4e29-aab2-a5aae73f221b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.321782] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "port-12a33f3b-4ec4-4e29-aab2-a5aae73f221b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.322143] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "port-12a33f3b-4ec4-4e29-aab2-a5aae73f221b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.322143] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12a33f3b-4ec4-4e29-aab2-a5aae73f221b',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 586.334186] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 201a25d1-d0dd-4929-b381-6fb228669b8b [ 586.334397] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.334397] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.334679] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.334679] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.334765] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.334905] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:201a25d1-d0dd-4929-b381-6fb228669b8b already deleted. [ 586.334965] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-201a25d1-d0dd-4929-b381-6fb228669b8b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.828108] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.828365] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.828488] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.828807] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.829120] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.829321] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Segment Port 12a33f3b-4ec4-4e29-aab2-a5aae73f221b not found, creating... [ 586.829599] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.829786] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.829902] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.830141] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.830275] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.830647] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.830914] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.830914] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.831419] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.831596] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.831783] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Resource: SegmentPort with ID: 12a33f3b-4ec4-4e29-aab2-a5aae73f221b is going to be created. [ 586.868794] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 586.869042] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 586.869142] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 586.869408] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 586.869633] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 586.869846] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "port-12a33f3b-4ec4-4e29-aab2-a5aae73f221b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.388560] env[67094]: INFO networking_nsxv3.common.synchronization [req-0d303241-37f9-4cc0-82cb-fbaa84a61a8d req-271f16fd-09b2-42c2-a8eb-25355ad0a3b4 tempest-DeleteServersAdminTestJSON-1006034417 tempest-DeleteServersAdminTestJSON-1006034417-project-member] Enqueued Resource ID: 34103f55-eb7e-4602-9672-09596df7eaa4 with Priority: HIGHEST for action security_group_members [ 587.389133] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34103f55-eb7e-4602-9672-09596df7eaa4 with Priority: HIGHEST for action security_group_members [ 587.389432] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-34103f55-eb7e-4602-9672-09596df7eaa4 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.389561] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34103f55-eb7e-4602-9672-09596df7eaa4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.389634] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34103f55-eb7e-4602-9672-09596df7eaa4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.389914] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34103f55-eb7e-4602-9672-09596df7eaa4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.392776] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.393017] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.393102] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.393280] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.393369] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.393467] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34103f55-eb7e-4602-9672-09596df7eaa4',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.508482] env[67094]: INFO networking_nsxv3.common.synchronization [None req-9cd597dc-6df6-45b9-8600-a2a3dc6ccd3d None None] Enqueued Resource ID: cc925dd2-63bc-42a7-9b65-d19681cd8007 with Priority: HIGHEST for action port [ 587.508482] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc925dd2-63bc-42a7-9b65-d19681cd8007 with Priority: HIGHEST for action port [ 587.508482] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-cc925dd2-63bc-42a7-9b65-d19681cd8007 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.508697] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cc925dd2-63bc-42a7-9b65-d19681cd8007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.508697] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cc925dd2-63bc-42a7-9b65-d19681cd8007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.508925] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cc925dd2-63bc-42a7-9b65-d19681cd8007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.508996] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc925dd2-63bc-42a7-9b65-d19681cd8007',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.640811] env[67094]: INFO networking_nsxv3.common.synchronization [req-7934573a-dc78-4664-b7dd-991eec4fdbc1 req-3fa29435-63b0-46b2-8e7e-3e5e30e17324 service nova] Enqueued Resource ID: cb367675-42aa-4b50-8812-8a73fdef747d with Priority: HIGHEST for action security_group_rules [ 587.640811] env[67094]: INFO networking_nsxv3.common.synchronization [req-7934573a-dc78-4664-b7dd-991eec4fdbc1 req-3fa29435-63b0-46b2-8e7e-3e5e30e17324 service nova] Enqueued Resource ID: cb367675-42aa-4b50-8812-8a73fdef747d with Priority: HIGHEST for action security_group_members [ 587.640811] env[67094]: INFO networking_nsxv3.common.synchronization [req-7934573a-dc78-4664-b7dd-991eec4fdbc1 req-3fa29435-63b0-46b2-8e7e-3e5e30e17324 service nova] Enqueued Resource ID: 12a33f3b-4ec4-4e29-aab2-a5aae73f221b with Priority: HIGHEST for action port [ 587.641319] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb367675-42aa-4b50-8812-8a73fdef747d with Priority: HIGHEST for action security_group_rules [ 587.641453] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb367675-42aa-4b50-8812-8a73fdef747d with Priority: HIGHEST for action security_group_members [ 587.641561] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 12a33f3b-4ec4-4e29-aab2-a5aae73f221b with Priority: HIGHEST for action port [ 587.641860] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-cb367675-42aa-4b50-8812-8a73fdef747d taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.641971] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-cb367675-42aa-4b50-8812-8a73fdef747d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.644935] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-cb367675-42aa-4b50-8812-8a73fdef747d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.644935] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-cb367675-42aa-4b50-8812-8a73fdef747d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.645082] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('cb367675-42aa-4b50-8812-8a73fdef747d',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.646614] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb367675-42aa-4b50-8812-8a73fdef747d taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.646856] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb367675-42aa-4b50-8812-8a73fdef747d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.646906] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb367675-42aa-4b50-8812-8a73fdef747d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.647148] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb367675-42aa-4b50-8812-8a73fdef747d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.647385] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.647487] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.649449] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.649449] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.649449] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.649449] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb367675-42aa-4b50-8812-8a73fdef747d',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.649449] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-12a33f3b-4ec4-4e29-aab2-a5aae73f221b taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.649686] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-12a33f3b-4ec4-4e29-aab2-a5aae73f221b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.649686] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-12a33f3b-4ec4-4e29-aab2-a5aae73f221b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.649833] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-12a33f3b-4ec4-4e29-aab2-a5aae73f221b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.649976] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('12a33f3b-4ec4-4e29-aab2-a5aae73f221b',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 587.888345] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock network-653 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.888606] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "network-653" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.889276] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "network-653" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.889276] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "network-653" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.889276] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.890113] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.890113] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.890113] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.890113] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.890113] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 587.890248] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 587.890248] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 587.890347] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 587.890487] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 587.890626] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 587.890661] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 587.898969] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.898969] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.898969] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.898969] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.898969] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.899214] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.899214] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.899283] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.899441] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.899544] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.899653] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34103f55-eb7e-4602-9672-09596df7eaa4 already deleted. [ 587.899735] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34103f55-eb7e-4602-9672-09596df7eaa4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.910978] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 587.911170] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 587.911301] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 587.911470] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "network-653" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 587.911822] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock port-c4f25399-35f1-4192-89ca-5e543e535ddd taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 587.911987] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "port-c4f25399-35f1-4192-89ca-5e543e535ddd" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 587.912058] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "port-c4f25399-35f1-4192-89ca-5e543e535ddd" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 587.912353] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "port-c4f25399-35f1-4192-89ca-5e543e535ddd" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 587.912486] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4f25399-35f1-4192-89ca-5e543e535ddd',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.010518] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cc925dd2-63bc-42a7-9b65-d19681cd8007 [ 588.010843] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.011089] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.011209] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.011498] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.011671] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.011821] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cc925dd2-63bc-42a7-9b65-d19681cd8007 already deleted. [ 588.011931] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cc925dd2-63bc-42a7-9b65-d19681cd8007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.148774] env[67094]: INFO networking_nsxv3.common.synchronization [None req-ef7e2f8f-9bea-4379-b26a-67c99333f30e None None] Enqueued Resource ID: 51f4cb1b-b848-40a6-bd1d-6330e9debca2 with Priority: HIGHEST for action port [ 588.148774] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51f4cb1b-b848-40a6-bd1d-6330e9debca2 with Priority: HIGHEST for action port [ 588.148774] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-51f4cb1b-b848-40a6-bd1d-6330e9debca2 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.148774] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-51f4cb1b-b848-40a6-bd1d-6330e9debca2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.148774] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-51f4cb1b-b848-40a6-bd1d-6330e9debca2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.149578] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-51f4cb1b-b848-40a6-bd1d-6330e9debca2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.149672] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51f4cb1b-b848-40a6-bd1d-6330e9debca2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.152156] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb367675-42aa-4b50-8812-8a73fdef747d taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.152156] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb367675-42aa-4b50-8812-8a73fdef747d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.161267] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 12a33f3b-4ec4-4e29-aab2-a5aae73f221b with status ACTIVE [ 588.161475] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.161597] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.161665] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.161863] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.161951] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.162133] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.162231] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.162290] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.162434] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.162511] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.162683] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.162769] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.162831] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.162964] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.163048] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.163131] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 12a33f3b-4ec4-4e29-aab2-a5aae73f221b is going to be updated. [ 588.164201] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('cb367675-42aa-4b50-8812-8a73fdef747d',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 588.195186] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.195353] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.195409] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.195603] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.195738] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.195888] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-12a33f3b-4ec4-4e29-aab2-a5aae73f221b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.416641] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.416895] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.417033] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.417300] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.417444] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.417594] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Segment Port c4f25399-35f1-4192-89ca-5e543e535ddd not found, creating... [ 588.417849] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.418008] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.418147] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.418356] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.418483] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.418763] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.419016] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.421543] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.422259] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.422422] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.422571] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Resource: SegmentPort with ID: c4f25399-35f1-4192-89ca-5e543e535ddd is going to be created. [ 588.446125] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.446342] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.446463] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.446785] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.447051] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.448637] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "port-c4f25399-35f1-4192-89ca-5e543e535ddd" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.654441] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 51f4cb1b-b848-40a6-bd1d-6330e9debca2 [ 588.654657] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 588.654657] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 588.655568] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 588.655568] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 588.655568] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.655568] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:51f4cb1b-b848-40a6-bd1d-6330e9debca2 already deleted. [ 588.655568] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-51f4cb1b-b848-40a6-bd1d-6330e9debca2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 588.668076] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('cb367675-42aa-4b50-8812-8a73fdef747d',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.172147] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.172147] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.172147] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.172147] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.172147] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.172147] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb367675-42aa-4b50-8812-8a73fdef747d is going to be created. [ 589.250579] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.250742] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.250810] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.251073] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.251250] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.264203] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb367675-42aa-4b50-8812-8a73fdef747d in Status: UNINITIALIZED for 2s [ 589.439902] env[67094]: INFO networking_nsxv3.common.synchronization [None req-8b3fb2a7-a3d9-4117-ae5c-64952e40f47e None None] Enqueued Resource ID: 85256062-4150-4b62-bb9f-3b42d632e109 with Priority: HIGHEST for action port [ 589.440081] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85256062-4150-4b62-bb9f-3b42d632e109 with Priority: HIGHEST for action port [ 589.441073] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-85256062-4150-4b62-bb9f-3b42d632e109 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.441182] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-85256062-4150-4b62-bb9f-3b42d632e109" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.441182] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-85256062-4150-4b62-bb9f-3b42d632e109" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.441417] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-85256062-4150-4b62-bb9f-3b42d632e109" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.441518] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('85256062-4150-4b62-bb9f-3b42d632e109',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.544266] env[67094]: INFO networking_nsxv3.common.synchronization [req-0d303241-37f9-4cc0-82cb-fbaa84a61a8d req-c531422f-d770-4a2b-a539-19dac6907d44 service nova] Enqueued Resource ID: 34103f55-eb7e-4602-9672-09596df7eaa4 with Priority: HIGHEST for action security_group_rules [ 589.544266] env[67094]: INFO networking_nsxv3.common.synchronization [req-0d303241-37f9-4cc0-82cb-fbaa84a61a8d req-c531422f-d770-4a2b-a539-19dac6907d44 service nova] Enqueued Resource ID: 34103f55-eb7e-4602-9672-09596df7eaa4 with Priority: HIGHEST for action security_group_members [ 589.544266] env[67094]: INFO networking_nsxv3.common.synchronization [req-0d303241-37f9-4cc0-82cb-fbaa84a61a8d req-c531422f-d770-4a2b-a539-19dac6907d44 service nova] Enqueued Resource ID: c4f25399-35f1-4192-89ca-5e543e535ddd with Priority: HIGHEST for action port [ 589.544266] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34103f55-eb7e-4602-9672-09596df7eaa4 with Priority: HIGHEST for action security_group_rules [ 589.544266] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34103f55-eb7e-4602-9672-09596df7eaa4 with Priority: HIGHEST for action security_group_members [ 589.544266] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c4f25399-35f1-4192-89ca-5e543e535ddd with Priority: HIGHEST for action port [ 589.544838] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-34103f55-eb7e-4602-9672-09596df7eaa4 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.544966] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-34103f55-eb7e-4602-9672-09596df7eaa4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.545379] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-34103f55-eb7e-4602-9672-09596df7eaa4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.546194] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-34103f55-eb7e-4602-9672-09596df7eaa4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.546194] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('34103f55-eb7e-4602-9672-09596df7eaa4',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.546577] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-34103f55-eb7e-4602-9672-09596df7eaa4 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.546692] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34103f55-eb7e-4602-9672-09596df7eaa4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.546756] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34103f55-eb7e-4602-9672-09596df7eaa4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.546919] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34103f55-eb7e-4602-9672-09596df7eaa4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.547069] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.548042] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.548042] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.548042] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.548042] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.548042] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34103f55-eb7e-4602-9672-09596df7eaa4',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.548715] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-c4f25399-35f1-4192-89ca-5e543e535ddd taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.549100] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c4f25399-35f1-4192-89ca-5e543e535ddd" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.549100] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c4f25399-35f1-4192-89ca-5e543e535ddd" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.549100] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c4f25399-35f1-4192-89ca-5e543e535ddd" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.549100] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c4f25399-35f1-4192-89ca-5e543e535ddd',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 589.944214] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 85256062-4150-4b62-bb9f-3b42d632e109 [ 589.944325] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 589.944423] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 589.944524] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 589.945274] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 589.945274] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 589.945274] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:85256062-4150-4b62-bb9f-3b42d632e109 already deleted. [ 589.945274] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-85256062-4150-4b62-bb9f-3b42d632e109" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.051384] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-34103f55-eb7e-4602-9672-09596df7eaa4 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.051512] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34103f55-eb7e-4602-9672-09596df7eaa4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.051680] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('34103f55-eb7e-4602-9672-09596df7eaa4',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.052566] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c4f25399-35f1-4192-89ca-5e543e535ddd with status ACTIVE [ 590.053139] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.053139] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.053139] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.058133] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.058133] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.058133] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.058133] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.058133] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.058133] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.058133] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.058133] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.058133] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.058133] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.058133] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.058531] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.058531] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c4f25399-35f1-4192-89ca-5e543e535ddd is going to be updated. [ 590.090434] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.090631] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.091357] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.091357] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.091357] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.091357] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c4f25399-35f1-4192-89ca-5e543e535ddd" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.343951] env[67094]: INFO networking_nsxv3.common.synchronization [None req-4c337b4e-06c0-4392-9a63-7932c4ecd5d4 tempest-VolumesAssistedSnapshotsTest-1350353743 tempest-VolumesAssistedSnapshotsTest-1350353743-project-member] Enqueued Resource ID: f71d6693-6145-4241-b055-f03e34f73c7f with Priority: HIGHEST for action security_group_rules [ 590.343951] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f71d6693-6145-4241-b055-f03e34f73c7f with Priority: HIGHEST for action security_group_rules [ 590.343951] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f71d6693-6145-4241-b055-f03e34f73c7f taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.343951] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f71d6693-6145-4241-b055-f03e34f73c7f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.343951] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f71d6693-6145-4241-b055-f03e34f73c7f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.344421] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f71d6693-6145-4241-b055-f03e34f73c7f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.344421] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f71d6693-6145-4241-b055-f03e34f73c7f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.488070] env[67094]: INFO networking_nsxv3.common.synchronization [None req-efb38c47-6368-43d9-9269-f4e6c2e2ad94 tempest-VolumesAssistedSnapshotsTest-1350353743 tempest-VolumesAssistedSnapshotsTest-1350353743-project-member] Enqueued Resource ID: f71d6693-6145-4241-b055-f03e34f73c7f with Priority: HIGHEST for action security_group_rules [ 590.488730] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f71d6693-6145-4241-b055-f03e34f73c7f with Priority: HIGHEST for action security_group_rules [ 590.492106] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f71d6693-6145-4241-b055-f03e34f73c7f taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.492106] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f71d6693-6145-4241-b055-f03e34f73c7f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.562138] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('34103f55-eb7e-4602-9672-09596df7eaa4',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 590.870193] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 590.870193] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 590.870193] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.870193] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.870193] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.870193] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f71d6693-6145-4241-b055-f03e34f73c7f already deleted. [ 590.870193] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f71d6693-6145-4241-b055-f03e34f73c7f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 590.870193] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f71d6693-6145-4241-b055-f03e34f73c7f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 590.870193] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f71d6693-6145-4241-b055-f03e34f73c7f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 590.870193] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f71d6693-6145-4241-b055-f03e34f73c7f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.066205] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.068909] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.068909] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.068909] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.068909] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.068909] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34103f55-eb7e-4602-9672-09596df7eaa4 is going to be created. [ 591.117175] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.117175] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.117175] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.117175] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.117175] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.131255] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34103f55-eb7e-4602-9672-09596df7eaa4 in Status: UNINITIALIZED for 2s [ 591.280417] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb367675-42aa-4b50-8812-8a73fdef747d in Status: SUCCESS [ 591.280417] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb367675-42aa-4b50-8812-8a73fdef747d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.280417] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb367675-42aa-4b50-8812-8a73fdef747d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.280417] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb367675-42aa-4b50-8812-8a73fdef747d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.280417] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.280417] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.280417] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.280417] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.280417] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.280417] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb367675-42aa-4b50-8812-8a73fdef747d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.280417] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('cb367675-42aa-4b50-8812-8a73fdef747d',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.392657] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.392946] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.392946] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.393098] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.393186] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.393278] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f71d6693-6145-4241-b055-f03e34f73c7f already deleted. [ 591.393357] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f71d6693-6145-4241-b055-f03e34f73c7f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.519305] env[67094]: INFO networking_nsxv3.common.synchronization [req-66dfc39e-ae61-4996-93d7-e585d2028f36 req-697b1f8c-cfc1-436e-bb99-94955191ef36 tempest-ServerExternalEventsTest-1243958627 tempest-ServerExternalEventsTest-1243958627-project-member] Enqueued Resource ID: 6427f088-550f-4c69-a5dd-5f9c7d4aadcf with Priority: HIGHEST for action security_group_members [ 591.519305] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6427f088-550f-4c69-a5dd-5f9c7d4aadcf with Priority: HIGHEST for action security_group_members [ 591.519305] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-6427f088-550f-4c69-a5dd-5f9c7d4aadcf taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.519305] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6427f088-550f-4c69-a5dd-5f9c7d4aadcf" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.519305] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6427f088-550f-4c69-a5dd-5f9c7d4aadcf" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.519305] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6427f088-550f-4c69-a5dd-5f9c7d4aadcf" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.520934] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.520934] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.520934] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.520934] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.520934] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.520934] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6427f088-550f-4c69-a5dd-5f9c7d4aadcf',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.782216] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb367675-42aa-4b50-8812-8a73fdef747d taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.782412] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb367675-42aa-4b50-8812-8a73fdef747d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.782479] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb367675-42aa-4b50-8812-8a73fdef747d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.783144] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb367675-42aa-4b50-8812-8a73fdef747d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.783144] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.783144] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.783144] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.783369] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.783369] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.783369] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb367675-42aa-4b50-8812-8a73fdef747d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.784604] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb367675-42aa-4b50-8812-8a73fdef747d taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.784604] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb367675-42aa-4b50-8812-8a73fdef747d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.784604] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb367675-42aa-4b50-8812-8a73fdef747d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.784604] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb367675-42aa-4b50-8812-8a73fdef747d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.784604] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.784604] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.784604] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.784604] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.784604] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.784604] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb367675-42aa-4b50-8812-8a73fdef747d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 591.784604] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('cb367675-42aa-4b50-8812-8a73fdef747d',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 591.861849] env[67094]: INFO networking_nsxv3.common.synchronization [None req-c213c159-9643-46b8-8733-46cca9d4c0e2 None None] Enqueued Resource ID: dbb9056a-d1f3-4d16-a049-2d8e051aef46 with Priority: HIGHEST for action port [ 591.861936] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbb9056a-d1f3-4d16-a049-2d8e051aef46 with Priority: HIGHEST for action port [ 591.864368] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-dbb9056a-d1f3-4d16-a049-2d8e051aef46 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 591.864684] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dbb9056a-d1f3-4d16-a049-2d8e051aef46" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 591.864808] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dbb9056a-d1f3-4d16-a049-2d8e051aef46" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 591.865386] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dbb9056a-d1f3-4d16-a049-2d8e051aef46" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 591.865386] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dbb9056a-d1f3-4d16-a049-2d8e051aef46',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.023417] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.023642] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.023642] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.023888] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.024021] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.024261] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.024373] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.024427] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.024650] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.024729] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.024815] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6427f088-550f-4c69-a5dd-5f9c7d4aadcf already deleted. [ 592.024904] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6427f088-550f-4c69-a5dd-5f9c7d4aadcf" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.086431] env[67094]: INFO networking_nsxv3.common.synchronization [None req-ac45808f-da1a-4d63-98f2-c68bedf0395e None None] Enqueued Resource ID: 423902c2-83fe-4a98-b082-d43b164ec1bd with Priority: HIGHEST for action port [ 592.086431] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 423902c2-83fe-4a98-b082-d43b164ec1bd with Priority: HIGHEST for action port [ 592.086431] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-423902c2-83fe-4a98-b082-d43b164ec1bd taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.086431] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-423902c2-83fe-4a98-b082-d43b164ec1bd" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.086431] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-423902c2-83fe-4a98-b082-d43b164ec1bd" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.086431] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-423902c2-83fe-4a98-b082-d43b164ec1bd" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.086431] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('423902c2-83fe-4a98-b082-d43b164ec1bd',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.198466] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock network-653 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.198649] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "network-653" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.198770] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "network-653" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.199059] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "network-653" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.199311] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.200227] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.200227] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.200227] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.200227] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.200227] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 592.200427] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 592.200427] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 592.200488] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 592.200870] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 592.200870] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 592.200870] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 592.220812] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 592.220983] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 592.221128] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 592.221293] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "network-653" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.221615] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock port-dcc69b17-d75b-48d3-8353-02b85ea6300f taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.221759] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "port-dcc69b17-d75b-48d3-8353-02b85ea6300f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.221855] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "port-dcc69b17-d75b-48d3-8353-02b85ea6300f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.222190] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "port-dcc69b17-d75b-48d3-8353-02b85ea6300f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.222323] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dcc69b17-d75b-48d3-8353-02b85ea6300f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 592.287471] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for cb367675-42aa-4b50-8812-8a73fdef747d: rpc.has_security_group_logging(os_id): False [ 592.315354] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.316709] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.316709] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.316709] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.316709] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.316709] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.316709] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.316709] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.316987] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.316987] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.317511] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.318363] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.318363] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.318363] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.318363] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.318363] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.318663] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.318820] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.319049] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.319138] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.320132] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: cb367675-42aa-4b50-8812-8a73fdef747d is going to be created. [ 592.367629] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dbb9056a-d1f3-4d16-a049-2d8e051aef46 [ 592.368064] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.368234] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.368295] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.368464] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.368563] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.368662] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dbb9056a-d1f3-4d16-a049-2d8e051aef46 already deleted. [ 592.368732] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dbb9056a-d1f3-4d16-a049-2d8e051aef46" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.431383] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.431963] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.431963] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.431963] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.432222] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.449243] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb367675-42aa-4b50-8812-8a73fdef747d in Status: IN_PROGRESS for 2s [ 592.589292] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 423902c2-83fe-4a98-b082-d43b164ec1bd [ 592.589292] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.589461] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.589540] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.589832] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.590136] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.590238] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:423902c2-83fe-4a98-b082-d43b164ec1bd already deleted. [ 592.590634] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-423902c2-83fe-4a98-b082-d43b164ec1bd" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.725123] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.725357] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.725477] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.725743] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.725887] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.726044] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Segment Port dcc69b17-d75b-48d3-8353-02b85ea6300f not found, creating... [ 592.726296] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.726445] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.726600] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.726824] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.726996] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.727317] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.727517] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.727683] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.727918] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.728182] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.728364] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Resource: SegmentPort with ID: dcc69b17-d75b-48d3-8353-02b85ea6300f is going to be created. [ 592.747365] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 592.747599] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 592.747730] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 592.748280] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 592.748578] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 592.748762] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "port-dcc69b17-d75b-48d3-8353-02b85ea6300f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.144365] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34103f55-eb7e-4602-9672-09596df7eaa4 in Status: SUCCESS [ 593.144365] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34103f55-eb7e-4602-9672-09596df7eaa4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.144365] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34103f55-eb7e-4602-9672-09596df7eaa4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.144365] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34103f55-eb7e-4602-9672-09596df7eaa4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.144365] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.144365] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.144365] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.144365] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.144365] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.144365] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34103f55-eb7e-4602-9672-09596df7eaa4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.144365] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('34103f55-eb7e-4602-9672-09596df7eaa4',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.453034] env[67094]: INFO networking_nsxv3.common.synchronization [req-66dfc39e-ae61-4996-93d7-e585d2028f36 req-a6f78289-c72c-4ff9-a9b7-1de7cdb2c79b service nova] Enqueued Resource ID: 6427f088-550f-4c69-a5dd-5f9c7d4aadcf with Priority: HIGHEST for action security_group_rules [ 593.453034] env[67094]: INFO networking_nsxv3.common.synchronization [req-66dfc39e-ae61-4996-93d7-e585d2028f36 req-a6f78289-c72c-4ff9-a9b7-1de7cdb2c79b service nova] Enqueued Resource ID: 6427f088-550f-4c69-a5dd-5f9c7d4aadcf with Priority: HIGHEST for action security_group_members [ 593.453034] env[67094]: INFO networking_nsxv3.common.synchronization [req-66dfc39e-ae61-4996-93d7-e585d2028f36 req-a6f78289-c72c-4ff9-a9b7-1de7cdb2c79b service nova] Enqueued Resource ID: dcc69b17-d75b-48d3-8353-02b85ea6300f with Priority: HIGHEST for action port [ 593.454529] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6427f088-550f-4c69-a5dd-5f9c7d4aadcf with Priority: HIGHEST for action security_group_rules [ 593.454846] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6427f088-550f-4c69-a5dd-5f9c7d4aadcf with Priority: HIGHEST for action security_group_members [ 593.456546] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dcc69b17-d75b-48d3-8353-02b85ea6300f with Priority: HIGHEST for action port [ 593.456546] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6427f088-550f-4c69-a5dd-5f9c7d4aadcf taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.456546] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6427f088-550f-4c69-a5dd-5f9c7d4aadcf" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.456546] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6427f088-550f-4c69-a5dd-5f9c7d4aadcf" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.456546] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6427f088-550f-4c69-a5dd-5f9c7d4aadcf" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.456546] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6427f088-550f-4c69-a5dd-5f9c7d4aadcf',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.457297] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-6427f088-550f-4c69-a5dd-5f9c7d4aadcf taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.457408] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6427f088-550f-4c69-a5dd-5f9c7d4aadcf" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.457573] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6427f088-550f-4c69-a5dd-5f9c7d4aadcf" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.457888] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6427f088-550f-4c69-a5dd-5f9c7d4aadcf" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.458143] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.458330] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.458654] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.458654] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.460319] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.460319] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6427f088-550f-4c69-a5dd-5f9c7d4aadcf',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.460319] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-dcc69b17-d75b-48d3-8353-02b85ea6300f taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.460319] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dcc69b17-d75b-48d3-8353-02b85ea6300f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.460319] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dcc69b17-d75b-48d3-8353-02b85ea6300f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.460319] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dcc69b17-d75b-48d3-8353-02b85ea6300f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.460319] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dcc69b17-d75b-48d3-8353-02b85ea6300f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.647059] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-34103f55-eb7e-4602-9672-09596df7eaa4 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.647330] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34103f55-eb7e-4602-9672-09596df7eaa4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.647330] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34103f55-eb7e-4602-9672-09596df7eaa4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.648320] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34103f55-eb7e-4602-9672-09596df7eaa4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.648320] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.649496] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.649573] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.649884] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.650043] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.650113] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34103f55-eb7e-4602-9672-09596df7eaa4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.650316] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-34103f55-eb7e-4602-9672-09596df7eaa4 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.650492] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34103f55-eb7e-4602-9672-09596df7eaa4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.650538] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34103f55-eb7e-4602-9672-09596df7eaa4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.650717] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34103f55-eb7e-4602-9672-09596df7eaa4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.650935] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.651112] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.651143] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.651281] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.651542] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.651542] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34103f55-eb7e-4602-9672-09596df7eaa4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.651597] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('34103f55-eb7e-4602-9672-09596df7eaa4',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.962519] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-6427f088-550f-4c69-a5dd-5f9c7d4aadcf taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.962661] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6427f088-550f-4c69-a5dd-5f9c7d4aadcf" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.962851] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dcc69b17-d75b-48d3-8353-02b85ea6300f with status ACTIVE [ 593.963038] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.963530] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.963530] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.963530] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.963530] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.963690] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.963755] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.963815] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.963965] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.964052] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.964231] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.964321] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.964381] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.964518] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.964588] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.964672] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dcc69b17-d75b-48d3-8353-02b85ea6300f is going to be updated. [ 593.965769] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6427f088-550f-4c69-a5dd-5f9c7d4aadcf',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 593.990597] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 593.990957] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 593.991149] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 593.991632] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 593.991874] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 593.992175] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dcc69b17-d75b-48d3-8353-02b85ea6300f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.156052] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 34103f55-eb7e-4602-9672-09596df7eaa4: rpc.has_security_group_logging(os_id): False [ 594.178087] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.178087] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.178087] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.178087] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.178087] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.178087] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.178087] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.178628] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.178628] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.178628] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.178628] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.178748] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.178748] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.178844] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.178922] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.179566] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.179566] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.179566] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.179566] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.179566] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.179566] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 34103f55-eb7e-4602-9672-09596df7eaa4 is going to be created. [ 594.253226] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.253428] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.254173] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.254691] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.254886] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.267874] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34103f55-eb7e-4602-9672-09596df7eaa4 in Status: IN_PROGRESS for 2s [ 594.426936] env[67094]: INFO networking_nsxv3.common.synchronization [req-b338e159-9fed-4659-8054-27fc5934fc8c req-ddff993e-1baa-42fa-a219-7cc39a68ec28 tempest-ImagesOneServerTestJSON-1626915787 tempest-ImagesOneServerTestJSON-1626915787-project-member] Enqueued Resource ID: 0d0028b4-3629-4ade-8832-b0fbfb48d140 with Priority: HIGHEST for action security_group_members [ 594.426936] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d0028b4-3629-4ade-8832-b0fbfb48d140 with Priority: HIGHEST for action security_group_members [ 594.426936] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d0028b4-3629-4ade-8832-b0fbfb48d140 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.426936] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d0028b4-3629-4ade-8832-b0fbfb48d140" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.427205] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d0028b4-3629-4ade-8832-b0fbfb48d140" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.427547] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d0028b4-3629-4ade-8832-b0fbfb48d140" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.427547] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.427547] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.427547] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.428104] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.428104] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.428240] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0d0028b4-3629-4ade-8832-b0fbfb48d140',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.461584] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: cb367675-42aa-4b50-8812-8a73fdef747d in Status: SUCCESS [ 594.461986] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-cb367675-42aa-4b50-8812-8a73fdef747d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.468288] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6427f088-550f-4c69-a5dd-5f9c7d4aadcf',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 594.931590] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.931752] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.931869] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.932229] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.932229] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.932373] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.933035] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.933035] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.933035] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.933035] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.933035] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d0028b4-3629-4ade-8832-b0fbfb48d140 already deleted. [ 594.933035] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d0028b4-3629-4ade-8832-b0fbfb48d140" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.970819] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.971614] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.971614] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.971614] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.971614] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 594.971614] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6427f088-550f-4c69-a5dd-5f9c7d4aadcf is going to be created. [ 594.997120] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 594.997886] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 594.997886] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 594.997886] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 594.997886] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.008369] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6427f088-550f-4c69-a5dd-5f9c7d4aadcf in Status: UNINITIALIZED for 2s [ 595.269695] env[67094]: INFO networking_nsxv3.common.synchronization [None req-74e68540-a604-4c4b-90ad-250b56a200f2 None None] Enqueued Resource ID: fa86bc3e-e702-48de-bfa3-233783b503a4 with Priority: HIGHEST for action port [ 595.270494] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa86bc3e-e702-48de-bfa3-233783b503a4 with Priority: HIGHEST for action port [ 595.270841] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-fa86bc3e-e702-48de-bfa3-233783b503a4 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.270997] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fa86bc3e-e702-48de-bfa3-233783b503a4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.271056] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fa86bc3e-e702-48de-bfa3-233783b503a4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.271337] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fa86bc3e-e702-48de-bfa3-233783b503a4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.271670] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa86bc3e-e702-48de-bfa3-233783b503a4',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.280195] env[67094]: INFO networking_nsxv3.common.synchronization [None req-de3993f3-1382-4f07-a262-de340252f4ee None None] Enqueued Resource ID: dceca50a-608d-4372-83c7-80fe91613f18 with Priority: HIGHEST for action port [ 595.280449] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dceca50a-608d-4372-83c7-80fe91613f18 with Priority: HIGHEST for action port [ 595.280995] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-dceca50a-608d-4372-83c7-80fe91613f18 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.281144] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dceca50a-608d-4372-83c7-80fe91613f18" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.281211] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dceca50a-608d-4372-83c7-80fe91613f18" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.281463] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dceca50a-608d-4372-83c7-80fe91613f18" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.281549] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dceca50a-608d-4372-83c7-80fe91613f18',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.290842] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock network-119 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.291060] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "network-119" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.291202] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "network-119" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.291456] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "network-119" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.291708] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.291859] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.291969] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.292350] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.292500] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.292703] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 595.292808] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 595.292906] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 595.293083] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 595.293218] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 595.293326] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 595.293450] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 595.321086] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 595.321234] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 595.321370] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 595.321546] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "network-119" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.321879] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock port-3333766d-1b63-41dd-a3b9-cb6c6085657e taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.322057] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "port-3333766d-1b63-41dd-a3b9-cb6c6085657e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.322171] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "port-3333766d-1b63-41dd-a3b9-cb6c6085657e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.322557] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "port-3333766d-1b63-41dd-a3b9-cb6c6085657e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.322615] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3333766d-1b63-41dd-a3b9-cb6c6085657e',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 595.776011] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fa86bc3e-e702-48de-bfa3-233783b503a4 [ 595.776011] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.777842] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.777842] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.777842] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.777842] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.777842] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fa86bc3e-e702-48de-bfa3-233783b503a4 already deleted. [ 595.778128] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fa86bc3e-e702-48de-bfa3-233783b503a4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.783287] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port dceca50a-608d-4372-83c7-80fe91613f18 [ 595.784683] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.784683] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.784683] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.784683] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.784683] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.784683] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:dceca50a-608d-4372-83c7-80fe91613f18 already deleted. [ 595.784683] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dceca50a-608d-4372-83c7-80fe91613f18" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.825184] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.825405] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.825569] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.825853] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.825963] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.826180] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Segment Port 3333766d-1b63-41dd-a3b9-cb6c6085657e not found, creating... [ 595.826649] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.826649] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.826816] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.826998] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.827159] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.827469] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.828012] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.828012] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.828085] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.828208] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.828346] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Resource: SegmentPort with ID: 3333766d-1b63-41dd-a3b9-cb6c6085657e is going to be created. [ 595.849904] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 595.850536] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 595.850536] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 595.850536] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 595.850819] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 595.850922] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "port-3333766d-1b63-41dd-a3b9-cb6c6085657e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.278970] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34103f55-eb7e-4602-9672-09596df7eaa4 in Status: SUCCESS [ 596.278970] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-34103f55-eb7e-4602-9672-09596df7eaa4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.592535] env[67094]: INFO networking_nsxv3.common.synchronization [req-b338e159-9fed-4659-8054-27fc5934fc8c req-a3f69804-79af-451b-8080-84048f093561 service nova] Enqueued Resource ID: 0d0028b4-3629-4ade-8832-b0fbfb48d140 with Priority: HIGHEST for action security_group_rules [ 596.592535] env[67094]: INFO networking_nsxv3.common.synchronization [req-b338e159-9fed-4659-8054-27fc5934fc8c req-a3f69804-79af-451b-8080-84048f093561 service nova] Enqueued Resource ID: 0d0028b4-3629-4ade-8832-b0fbfb48d140 with Priority: HIGHEST for action security_group_members [ 596.592819] env[67094]: INFO networking_nsxv3.common.synchronization [req-b338e159-9fed-4659-8054-27fc5934fc8c req-a3f69804-79af-451b-8080-84048f093561 service nova] Enqueued Resource ID: 3333766d-1b63-41dd-a3b9-cb6c6085657e with Priority: HIGHEST for action port [ 596.593475] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d0028b4-3629-4ade-8832-b0fbfb48d140 with Priority: HIGHEST for action security_group_rules [ 596.593594] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d0028b4-3629-4ade-8832-b0fbfb48d140 with Priority: HIGHEST for action security_group_members [ 596.593653] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3333766d-1b63-41dd-a3b9-cb6c6085657e with Priority: HIGHEST for action port [ 596.594213] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0d0028b4-3629-4ade-8832-b0fbfb48d140 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.594213] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0d0028b4-3629-4ade-8832-b0fbfb48d140" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.594213] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0d0028b4-3629-4ade-8832-b0fbfb48d140" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.595339] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0d0028b4-3629-4ade-8832-b0fbfb48d140" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.595339] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0d0028b4-3629-4ade-8832-b0fbfb48d140',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.596160] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d0028b4-3629-4ade-8832-b0fbfb48d140 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.596160] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d0028b4-3629-4ade-8832-b0fbfb48d140" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.596160] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d0028b4-3629-4ade-8832-b0fbfb48d140" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.597860] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d0028b4-3629-4ade-8832-b0fbfb48d140" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.597860] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.597860] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.597860] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.597860] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.597860] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 596.597860] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0d0028b4-3629-4ade-8832-b0fbfb48d140',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 596.599087] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-3333766d-1b63-41dd-a3b9-cb6c6085657e taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 596.599227] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3333766d-1b63-41dd-a3b9-cb6c6085657e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 596.599295] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3333766d-1b63-41dd-a3b9-cb6c6085657e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 596.599477] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3333766d-1b63-41dd-a3b9-cb6c6085657e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 596.599559] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3333766d-1b63-41dd-a3b9-cb6c6085657e',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.021875] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6427f088-550f-4c69-a5dd-5f9c7d4aadcf in Status: SUCCESS [ 597.022233] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6427f088-550f-4c69-a5dd-5f9c7d4aadcf" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.022380] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6427f088-550f-4c69-a5dd-5f9c7d4aadcf" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.022691] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6427f088-550f-4c69-a5dd-5f9c7d4aadcf" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.022897] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.023030] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.023097] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.023332] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.023421] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.023508] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6427f088-550f-4c69-a5dd-5f9c7d4aadcf" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.023598] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6427f088-550f-4c69-a5dd-5f9c7d4aadcf',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.102035] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d0028b4-3629-4ade-8832-b0fbfb48d140 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.102373] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d0028b4-3629-4ade-8832-b0fbfb48d140" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.102455] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0d0028b4-3629-4ade-8832-b0fbfb48d140',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.103595] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3333766d-1b63-41dd-a3b9-cb6c6085657e with status ACTIVE [ 597.103669] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.103766] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.103853] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.104083] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.104181] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.104399] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.104733] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.104733] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.104733] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.104733] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.107649] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.107649] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.108363] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.108800] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.108800] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.108942] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3333766d-1b63-41dd-a3b9-cb6c6085657e is going to be updated. [ 597.135985] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.136235] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.136286] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.136532] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.136784] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.137082] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3333766d-1b63-41dd-a3b9-cb6c6085657e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.282647] env[67094]: INFO networking_nsxv3.common.synchronization [req-8804fc6b-2bb8-4e8a-8d67-d9a87e8df181 req-a919f63f-4b0b-41fa-bfae-8fe96a973ce5 tempest-MigrationsAdminTest-1501090521 tempest-MigrationsAdminTest-1501090521-project-member] Enqueued Resource ID: fbf0de02-2c4b-4156-ae88-4a3e624f550d with Priority: HIGHEST for action security_group_members [ 597.282893] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbf0de02-2c4b-4156-ae88-4a3e624f550d with Priority: HIGHEST for action security_group_members [ 597.284253] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbf0de02-2c4b-4156-ae88-4a3e624f550d taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.284253] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbf0de02-2c4b-4156-ae88-4a3e624f550d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.284253] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbf0de02-2c4b-4156-ae88-4a3e624f550d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.284253] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbf0de02-2c4b-4156-ae88-4a3e624f550d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.284253] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.284814] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.284814] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.284814] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.285182] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.285356] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fbf0de02-2c4b-4156-ae88-4a3e624f550d',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.527548] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-6427f088-550f-4c69-a5dd-5f9c7d4aadcf taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.527768] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6427f088-550f-4c69-a5dd-5f9c7d4aadcf" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.527828] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6427f088-550f-4c69-a5dd-5f9c7d4aadcf" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.528100] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6427f088-550f-4c69-a5dd-5f9c7d4aadcf" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.528286] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.528398] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.528463] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.528715] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.528762] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.528846] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6427f088-550f-4c69-a5dd-5f9c7d4aadcf" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.529038] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-6427f088-550f-4c69-a5dd-5f9c7d4aadcf taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.529139] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6427f088-550f-4c69-a5dd-5f9c7d4aadcf" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.529199] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6427f088-550f-4c69-a5dd-5f9c7d4aadcf" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.529352] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6427f088-550f-4c69-a5dd-5f9c7d4aadcf" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.529493] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.529673] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.529673] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.529813] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.529888] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.530020] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6427f088-550f-4c69-a5dd-5f9c7d4aadcf" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.530106] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6427f088-550f-4c69-a5dd-5f9c7d4aadcf',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.613339] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0d0028b4-3629-4ade-8832-b0fbfb48d140',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.789458] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.789615] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.789694] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.789906] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.789993] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.790211] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.790316] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.790378] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.790537] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.790616] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.790703] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fbf0de02-2c4b-4156-ae88-4a3e624f550d already deleted. [ 597.790782] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbf0de02-2c4b-4156-ae88-4a3e624f550d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.840497] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock network-653 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.840756] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "network-653" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.840893] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "network-653" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.841442] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "network-653" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.841798] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.842057] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.842305] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.842679] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.843141] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.843499] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 597.844187] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 597.844250] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 597.844406] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 597.844642] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 597.845077] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 597.845257] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 597.868910] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 597.868910] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 597.868910] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 597.868910] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "network-653" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 597.869192] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock port-54358476-390d-489a-9bb2-c508c03de5a6 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.870338] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "port-54358476-390d-489a-9bb2-c508c03de5a6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.870338] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "port-54358476-390d-489a-9bb2-c508c03de5a6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.870613] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "port-54358476-390d-489a-9bb2-c508c03de5a6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.870768] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54358476-390d-489a-9bb2-c508c03de5a6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 597.908967] env[67094]: INFO networking_nsxv3.common.synchronization [None req-229739b3-1a34-45d5-8da9-c211f8cb72d1 None None] Enqueued Resource ID: b156e528-2fe6-4b04-85cf-a7d6b73f3d2a with Priority: HIGHEST for action port [ 597.909916] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b156e528-2fe6-4b04-85cf-a7d6b73f3d2a with Priority: HIGHEST for action port [ 597.910169] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-b156e528-2fe6-4b04-85cf-a7d6b73f3d2a taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 597.910169] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b156e528-2fe6-4b04-85cf-a7d6b73f3d2a" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 597.910270] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b156e528-2fe6-4b04-85cf-a7d6b73f3d2a" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 597.910659] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b156e528-2fe6-4b04-85cf-a7d6b73f3d2a" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 597.910659] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b156e528-2fe6-4b04-85cf-a7d6b73f3d2a',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.037116] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6427f088-550f-4c69-a5dd-5f9c7d4aadcf: rpc.has_security_group_logging(os_id): False [ 598.057621] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.057858] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.057951] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.058269] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.058363] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.058570] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.058782] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.058782] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.058878] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.058948] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.059236] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.059985] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.059985] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.059985] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.059985] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.060383] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.060497] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.060585] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.060865] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.061152] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.061362] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6427f088-550f-4c69-a5dd-5f9c7d4aadcf is going to be created. [ 598.118296] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.118296] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.118296] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.118296] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.118296] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.118296] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d0028b4-3629-4ade-8832-b0fbfb48d140 is going to be created. [ 598.135835] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.135983] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.136757] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.136757] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.136757] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.152873] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6427f088-550f-4c69-a5dd-5f9c7d4aadcf in Status: IN_PROGRESS for 2s [ 598.162654] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.162876] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.162992] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.163574] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.163936] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.176163] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d0028b4-3629-4ade-8832-b0fbfb48d140 in Status: UNINITIALIZED for 2s [ 598.240153] env[67094]: INFO networking_nsxv3.common.synchronization [None req-3d6de2ec-61fc-46d7-90e0-8252f42c41bd None None] Enqueued Resource ID: d7fde8b2-4cd2-4c6b-a167-9c9ed70edb76 with Priority: HIGHEST for action port [ 598.240153] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d7fde8b2-4cd2-4c6b-a167-9c9ed70edb76 with Priority: HIGHEST for action port [ 598.240563] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-d7fde8b2-4cd2-4c6b-a167-9c9ed70edb76 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.240863] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d7fde8b2-4cd2-4c6b-a167-9c9ed70edb76" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.241048] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d7fde8b2-4cd2-4c6b-a167-9c9ed70edb76" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.242696] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d7fde8b2-4cd2-4c6b-a167-9c9ed70edb76" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.244886] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d7fde8b2-4cd2-4c6b-a167-9c9ed70edb76',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 598.375955] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.376275] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.376396] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.376801] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.376948] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.377185] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Segment Port 54358476-390d-489a-9bb2-c508c03de5a6 not found, creating... [ 598.377560] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.377754] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.377877] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.378236] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.378641] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.379282] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.380767] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.380767] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.380767] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.380767] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.380767] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Resource: SegmentPort with ID: 54358476-390d-489a-9bb2-c508c03de5a6 is going to be created. [ 598.407357] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.407637] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.407771] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.408057] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.408290] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.408513] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "port-54358476-390d-489a-9bb2-c508c03de5a6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.412567] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b156e528-2fe6-4b04-85cf-a7d6b73f3d2a [ 598.412805] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.412916] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.412957] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.413172] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.413607] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.413607] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b156e528-2fe6-4b04-85cf-a7d6b73f3d2a already deleted. [ 598.413607] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b156e528-2fe6-4b04-85cf-a7d6b73f3d2a" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.746925] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d7fde8b2-4cd2-4c6b-a167-9c9ed70edb76 [ 598.747498] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 598.747498] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 598.747498] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 598.747752] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 598.747752] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 598.747861] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d7fde8b2-4cd2-4c6b-a167-9c9ed70edb76 already deleted. [ 598.749107] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d7fde8b2-4cd2-4c6b-a167-9c9ed70edb76" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.039952] env[67094]: INFO networking_nsxv3.common.synchronization [None req-ae5ee509-8b4d-4686-9361-532d72e89596 None None] Enqueued Resource ID: 5d48af45-29b4-4c39-8302-5d33cb5da6fc with Priority: HIGHEST for action port [ 599.040310] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d48af45-29b4-4c39-8302-5d33cb5da6fc with Priority: HIGHEST for action port [ 599.042019] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-5d48af45-29b4-4c39-8302-5d33cb5da6fc taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.042019] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5d48af45-29b4-4c39-8302-5d33cb5da6fc" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.042019] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5d48af45-29b4-4c39-8302-5d33cb5da6fc" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.042019] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5d48af45-29b4-4c39-8302-5d33cb5da6fc" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.042019] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d48af45-29b4-4c39-8302-5d33cb5da6fc',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.171104] env[67094]: INFO networking_nsxv3.common.synchronization [req-8804fc6b-2bb8-4e8a-8d67-d9a87e8df181 req-fcdaa672-27db-4f82-8444-1e7e3462a103 service nova] Enqueued Resource ID: fbf0de02-2c4b-4156-ae88-4a3e624f550d with Priority: HIGHEST for action security_group_rules [ 599.171104] env[67094]: INFO networking_nsxv3.common.synchronization [req-8804fc6b-2bb8-4e8a-8d67-d9a87e8df181 req-fcdaa672-27db-4f82-8444-1e7e3462a103 service nova] Enqueued Resource ID: fbf0de02-2c4b-4156-ae88-4a3e624f550d with Priority: HIGHEST for action security_group_members [ 599.171104] env[67094]: INFO networking_nsxv3.common.synchronization [req-8804fc6b-2bb8-4e8a-8d67-d9a87e8df181 req-fcdaa672-27db-4f82-8444-1e7e3462a103 service nova] Enqueued Resource ID: 54358476-390d-489a-9bb2-c508c03de5a6 with Priority: HIGHEST for action port [ 599.171104] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbf0de02-2c4b-4156-ae88-4a3e624f550d with Priority: HIGHEST for action security_group_rules [ 599.171104] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbf0de02-2c4b-4156-ae88-4a3e624f550d with Priority: HIGHEST for action security_group_members [ 599.171104] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54358476-390d-489a-9bb2-c508c03de5a6 with Priority: HIGHEST for action port [ 599.171104] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fbf0de02-2c4b-4156-ae88-4a3e624f550d taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.171104] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fbf0de02-2c4b-4156-ae88-4a3e624f550d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.171104] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fbf0de02-2c4b-4156-ae88-4a3e624f550d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.172724] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fbf0de02-2c4b-4156-ae88-4a3e624f550d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.174029] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fbf0de02-2c4b-4156-ae88-4a3e624f550d',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.175036] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbf0de02-2c4b-4156-ae88-4a3e624f550d taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.175812] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbf0de02-2c4b-4156-ae88-4a3e624f550d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.175812] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbf0de02-2c4b-4156-ae88-4a3e624f550d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.175812] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbf0de02-2c4b-4156-ae88-4a3e624f550d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.175970] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.176330] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.176401] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.176557] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.176696] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.176803] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fbf0de02-2c4b-4156-ae88-4a3e624f550d',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.178442] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-54358476-390d-489a-9bb2-c508c03de5a6 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.178442] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-54358476-390d-489a-9bb2-c508c03de5a6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.178442] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-54358476-390d-489a-9bb2-c508c03de5a6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.178706] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-54358476-390d-489a-9bb2-c508c03de5a6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.178706] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54358476-390d-489a-9bb2-c508c03de5a6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.338643] env[67094]: INFO networking_nsxv3.common.synchronization [req-b4a21d54-bb43-4b7c-b3b2-b94f506a178b req-348dba18-8061-431d-9c93-d611eb17ab99 tempest-ServersTestFqdnHostnames-1054617166 tempest-ServersTestFqdnHostnames-1054617166-project-member] Enqueued Resource ID: 0c6a3072-604c-444a-b4d4-9ed06e060bef with Priority: HIGHEST for action security_group_members [ 599.339223] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c6a3072-604c-444a-b4d4-9ed06e060bef with Priority: HIGHEST for action security_group_members [ 599.339524] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c6a3072-604c-444a-b4d4-9ed06e060bef taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.339880] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c6a3072-604c-444a-b4d4-9ed06e060bef" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.339880] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c6a3072-604c-444a-b4d4-9ed06e060bef" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.340034] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c6a3072-604c-444a-b4d4-9ed06e060bef" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.340152] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.340395] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.340395] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.340395] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.340604] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.340604] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c6a3072-604c-444a-b4d4-9ed06e060bef',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.543424] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5d48af45-29b4-4c39-8302-5d33cb5da6fc [ 599.543661] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.543814] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.543912] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.544192] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.544318] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.544399] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5d48af45-29b4-4c39-8302-5d33cb5da6fc already deleted. [ 599.544469] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5d48af45-29b4-4c39-8302-5d33cb5da6fc" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.677030] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbf0de02-2c4b-4156-ae88-4a3e624f550d taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.678094] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbf0de02-2c4b-4156-ae88-4a3e624f550d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.678599] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fbf0de02-2c4b-4156-ae88-4a3e624f550d',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.681501] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 54358476-390d-489a-9bb2-c508c03de5a6 with status ACTIVE [ 599.681711] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.681847] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.681934] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.682371] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.682371] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.682463] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.682555] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.684458] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.684458] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.684458] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.684458] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.684458] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.684458] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.684458] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.684458] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.684458] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 54358476-390d-489a-9bb2-c508c03de5a6 is going to be updated. [ 599.699202] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock network-877 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.700045] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "network-877" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.700045] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "network-877" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.700045] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "network-877" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.700229] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.700392] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.700514] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.700796] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.700978] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.701202] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 599.701309] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 599.701452] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 599.701608] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 599.701723] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 599.701827] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 599.701949] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 599.712877] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.712877] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.712877] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.713108] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.713199] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.713471] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-54358476-390d-489a-9bb2-c508c03de5a6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.727261] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 599.727480] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 599.729382] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 599.729533] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "network-877" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.731157] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock port-1360735f-ad2a-429c-aa49-d7dcf094e8d9 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.731384] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "port-1360735f-ad2a-429c-aa49-d7dcf094e8d9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.731507] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "port-1360735f-ad2a-429c-aa49-d7dcf094e8d9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.731816] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "port-1360735f-ad2a-429c-aa49-d7dcf094e8d9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.731956] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1360735f-ad2a-429c-aa49-d7dcf094e8d9',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 599.845730] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.845730] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.845730] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.845730] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.845730] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.845730] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 599.845730] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 599.845730] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 599.845730] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 599.845730] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 599.845730] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c6a3072-604c-444a-b4d4-9ed06e060bef already deleted. [ 599.845730] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c6a3072-604c-444a-b4d4-9ed06e060bef" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.165824] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6427f088-550f-4c69-a5dd-5f9c7d4aadcf in Status: SUCCESS [ 600.166263] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6427f088-550f-4c69-a5dd-5f9c7d4aadcf" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.182561] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fbf0de02-2c4b-4156-ae88-4a3e624f550d',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.186452] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d0028b4-3629-4ade-8832-b0fbfb48d140 in Status: SUCCESS [ 600.186848] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d0028b4-3629-4ade-8832-b0fbfb48d140" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.187041] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d0028b4-3629-4ade-8832-b0fbfb48d140" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.187266] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d0028b4-3629-4ade-8832-b0fbfb48d140" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.187805] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.187805] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.187805] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.188268] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.188572] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.188725] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d0028b4-3629-4ade-8832-b0fbfb48d140" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.188931] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0d0028b4-3629-4ade-8832-b0fbfb48d140',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.238063] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.238063] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.238063] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.238063] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.238063] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.238063] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Segment Port 1360735f-ad2a-429c-aa49-d7dcf094e8d9 not found, creating... [ 600.238063] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.238063] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.238063] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.238063] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.238063] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.238480] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.238480] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.238480] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.238580] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.240276] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.240276] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Resource: SegmentPort with ID: 1360735f-ad2a-429c-aa49-d7dcf094e8d9 is going to be created. [ 600.268243] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.268565] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.270125] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.270125] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.270125] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.270125] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "port-1360735f-ad2a-429c-aa49-d7dcf094e8d9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.687280] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.687280] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.687280] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.687280] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.687280] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.687280] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fbf0de02-2c4b-4156-ae88-4a3e624f550d is going to be created. [ 600.691597] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d0028b4-3629-4ade-8832-b0fbfb48d140 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.691597] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d0028b4-3629-4ade-8832-b0fbfb48d140" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.691597] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d0028b4-3629-4ade-8832-b0fbfb48d140" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.691597] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d0028b4-3629-4ade-8832-b0fbfb48d140" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.691597] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.691597] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.691597] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.691597] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.691597] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.692546] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d0028b4-3629-4ade-8832-b0fbfb48d140" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.692546] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d0028b4-3629-4ade-8832-b0fbfb48d140 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.692546] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d0028b4-3629-4ade-8832-b0fbfb48d140" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.692546] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d0028b4-3629-4ade-8832-b0fbfb48d140" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.692546] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d0028b4-3629-4ade-8832-b0fbfb48d140" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.692546] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.692546] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.692546] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.693048] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.693048] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.693048] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d0028b4-3629-4ade-8832-b0fbfb48d140" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.693048] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0d0028b4-3629-4ade-8832-b0fbfb48d140',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.712088] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.712471] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.712471] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.712753] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.713651] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.722458] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fbf0de02-2c4b-4156-ae88-4a3e624f550d in Status: UNINITIALIZED for 2s [ 600.960371] env[67094]: INFO networking_nsxv3.common.synchronization [req-b4a21d54-bb43-4b7c-b3b2-b94f506a178b req-18b8d1c5-368b-4042-b3fe-43f87321dd46 service nova] Enqueued Resource ID: 0c6a3072-604c-444a-b4d4-9ed06e060bef with Priority: HIGHEST for action security_group_rules [ 600.960371] env[67094]: INFO networking_nsxv3.common.synchronization [req-b4a21d54-bb43-4b7c-b3b2-b94f506a178b req-18b8d1c5-368b-4042-b3fe-43f87321dd46 service nova] Enqueued Resource ID: 0c6a3072-604c-444a-b4d4-9ed06e060bef with Priority: HIGHEST for action security_group_members [ 600.960371] env[67094]: INFO networking_nsxv3.common.synchronization [req-b4a21d54-bb43-4b7c-b3b2-b94f506a178b req-18b8d1c5-368b-4042-b3fe-43f87321dd46 service nova] Enqueued Resource ID: 1360735f-ad2a-429c-aa49-d7dcf094e8d9 with Priority: HIGHEST for action port [ 600.960371] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c6a3072-604c-444a-b4d4-9ed06e060bef with Priority: HIGHEST for action security_group_rules [ 600.960371] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c6a3072-604c-444a-b4d4-9ed06e060bef with Priority: HIGHEST for action security_group_members [ 600.960371] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1360735f-ad2a-429c-aa49-d7dcf094e8d9 with Priority: HIGHEST for action port [ 600.960371] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0c6a3072-604c-444a-b4d4-9ed06e060bef taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.960371] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0c6a3072-604c-444a-b4d4-9ed06e060bef" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.960371] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0c6a3072-604c-444a-b4d4-9ed06e060bef" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.960371] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0c6a3072-604c-444a-b4d4-9ed06e060bef" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.960371] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0c6a3072-604c-444a-b4d4-9ed06e060bef',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.962561] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c6a3072-604c-444a-b4d4-9ed06e060bef taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.962846] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c6a3072-604c-444a-b4d4-9ed06e060bef" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.962846] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c6a3072-604c-444a-b4d4-9ed06e060bef" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.963076] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c6a3072-604c-444a-b4d4-9ed06e060bef" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.963245] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.963323] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.963411] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.963738] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.963738] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 600.963738] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c6a3072-604c-444a-b4d4-9ed06e060bef',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 600.964717] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-1360735f-ad2a-429c-aa49-d7dcf094e8d9 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 600.964717] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1360735f-ad2a-429c-aa49-d7dcf094e8d9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 600.964717] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1360735f-ad2a-429c-aa49-d7dcf094e8d9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 600.964891] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1360735f-ad2a-429c-aa49-d7dcf094e8d9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 600.964891] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1360735f-ad2a-429c-aa49-d7dcf094e8d9',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.071521] env[67094]: INFO networking_nsxv3.common.synchronization [req-900cd0fa-29a5-4b86-b782-f362bf1fcc7a req-09386c41-bf27-427e-a0d2-7ee6d0c6b7a6 tempest-ServersTestMultiNic-1403718544 tempest-ServersTestMultiNic-1403718544-project-member] Enqueued Resource ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 with Priority: HIGHEST for action security_group_members [ 601.072718] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 with Priority: HIGHEST for action security_group_members [ 601.072718] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f15f829-bf18-4bc7-bdf2-32c359ef7028 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.072718] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.072718] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.073508] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.073846] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.074103] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.074201] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.074539] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.074682] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.074828] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f15f829-bf18-4bc7-bdf2-32c359ef7028',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.196041] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0d0028b4-3629-4ade-8832-b0fbfb48d140: rpc.has_security_group_logging(os_id): False [ 601.215562] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.215665] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.215735] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.215951] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.216811] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.216811] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.216811] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.216811] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.216811] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.216811] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.217204] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.217265] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.217307] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.217833] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.217917] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.218138] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.218238] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.218294] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.218440] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.218516] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.218599] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0d0028b4-3629-4ade-8832-b0fbfb48d140 is going to be created. [ 601.291184] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.291184] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.291184] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.291729] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.291729] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.306475] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0d0028b4-3629-4ade-8832-b0fbfb48d140 in Status: IN_PROGRESS for 2s [ 601.317465] env[67094]: INFO networking_nsxv3.common.synchronization [None req-ceafac31-ad23-4e70-bdc5-1fa1aba38fc3 None None] Enqueued Resource ID: 33475ff6-fec2-4f4d-9cfd-dffd6b3260a2 with Priority: HIGHEST for action port [ 601.320610] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33475ff6-fec2-4f4d-9cfd-dffd6b3260a2 with Priority: HIGHEST for action port [ 601.321373] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-33475ff6-fec2-4f4d-9cfd-dffd6b3260a2 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.322012] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-33475ff6-fec2-4f4d-9cfd-dffd6b3260a2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.322012] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-33475ff6-fec2-4f4d-9cfd-dffd6b3260a2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.322012] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-33475ff6-fec2-4f4d-9cfd-dffd6b3260a2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.322012] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33475ff6-fec2-4f4d-9cfd-dffd6b3260a2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.382933] env[67094]: INFO networking_nsxv3.common.synchronization [req-900cd0fa-29a5-4b86-b782-f362bf1fcc7a req-c39448a9-2830-408e-bf63-6a048b2f3a9c tempest-ServersTestMultiNic-1403718544 tempest-ServersTestMultiNic-1403718544-project-member] Enqueued Resource ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 with Priority: HIGHEST for action security_group_members [ 601.383648] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 with Priority: HIGHEST for action security_group_members [ 601.383938] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f15f829-bf18-4bc7-bdf2-32c359ef7028 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.386239] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.466598] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0c6a3072-604c-444a-b4d4-9ed06e060bef',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.468207] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c6a3072-604c-444a-b4d4-9ed06e060bef taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.470897] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c6a3072-604c-444a-b4d4-9ed06e060bef" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.471575] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1360735f-ad2a-429c-aa49-d7dcf094e8d9 with status ACTIVE [ 601.471575] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.471683] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.471717] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.471903] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.471987] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.472218] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.472312] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.472368] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.472521] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.472609] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.472787] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.472883] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.472929] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.473274] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.473274] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.473374] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1360735f-ad2a-429c-aa49-d7dcf094e8d9 is going to be updated. [ 601.502698] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.504548] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.504548] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.504548] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.504548] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.504548] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1360735f-ad2a-429c-aa49-d7dcf094e8d9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.578628] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.578803] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.578868] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.579122] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.579211] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.579421] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.579540] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.579616] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.579788] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.579907] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.579977] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 already deleted. [ 601.580075] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.580237] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.580389] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.580525] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.580620] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.580681] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.580820] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.580895] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.580984] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f15f829-bf18-4bc7-bdf2-32c359ef7028',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 601.824487] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 33475ff6-fec2-4f4d-9cfd-dffd6b3260a2 [ 601.824642] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.824776] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.824858] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 601.825094] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 601.825185] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.825280] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:33475ff6-fec2-4f4d-9cfd-dffd6b3260a2 already deleted. [ 601.825389] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-33475ff6-fec2-4f4d-9cfd-dffd6b3260a2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 601.833870] env[67094]: INFO networking_nsxv3.common.synchronization [req-900cd0fa-29a5-4b86-b782-f362bf1fcc7a req-e2ba7b49-96c6-4009-9ba6-c437c92fa6d0 tempest-ServersTestMultiNic-1403718544 tempest-ServersTestMultiNic-1403718544-project-member] Enqueued Resource ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 with Priority: HIGHEST for action security_group_members [ 601.833870] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 with Priority: HIGHEST for action security_group_members [ 601.833870] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f15f829-bf18-4bc7-bdf2-32c359ef7028 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 601.833870] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 601.971306] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0c6a3072-604c-444a-b4d4-9ed06e060bef',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.084468] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.084740] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.084740] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.084845] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.084972] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.085151] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.085266] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.085361] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.085586] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.085671] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.085768] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 already deleted. [ 602.085860] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.086056] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.086216] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.086375] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.086554] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.086731] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.086850] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.086939] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.087170] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f15f829-bf18-4bc7-bdf2-32c359ef7028',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.234581] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock network-560 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.235056] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "network-560" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.238441] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "network-560" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.238441] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "network-560" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.238441] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.238441] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.238441] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.238441] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.238441] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.238441] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 602.238441] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 602.238441] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 602.238441] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 602.238441] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 602.238441] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 602.238441] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 602.259371] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 602.262019] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 602.262019] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 602.262019] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "network-560" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.262019] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock port-43a92dae-5096-4758-8b46-ace29582dad4 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.262019] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "port-43a92dae-5096-4758-8b46-ace29582dad4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.262019] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "port-43a92dae-5096-4758-8b46-ace29582dad4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.262019] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "port-43a92dae-5096-4758-8b46-ace29582dad4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.262578] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43a92dae-5096-4758-8b46-ace29582dad4',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.474120] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.474408] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.474494] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.474843] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.474843] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.474958] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c6a3072-604c-444a-b4d4-9ed06e060bef is going to be created. [ 602.506180] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.506180] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.506180] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.506180] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.506180] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.518036] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c6a3072-604c-444a-b4d4-9ed06e060bef in Status: UNINITIALIZED for 2s [ 602.589469] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.589703] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.589703] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.589887] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.590136] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.590287] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.590386] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.590463] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.590641] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.590725] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.590817] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 already deleted. [ 602.590905] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.735444] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fbf0de02-2c4b-4156-ae88-4a3e624f550d in Status: SUCCESS [ 602.735444] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbf0de02-2c4b-4156-ae88-4a3e624f550d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.735444] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbf0de02-2c4b-4156-ae88-4a3e624f550d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.735812] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbf0de02-2c4b-4156-ae88-4a3e624f550d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.735926] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.736069] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.736123] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.736290] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.736485] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.736485] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbf0de02-2c4b-4156-ae88-4a3e624f550d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.736579] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fbf0de02-2c4b-4156-ae88-4a3e624f550d',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 602.764493] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.764762] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.764880] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.765175] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.765315] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.765460] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Segment Port 43a92dae-5096-4758-8b46-ace29582dad4 not found, creating... [ 602.765720] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.765868] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.765975] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.766214] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.766351] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.766628] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.766859] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.766983] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.767198] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.767335] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.767468] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Resource: SegmentPort with ID: 43a92dae-5096-4758-8b46-ace29582dad4 is going to be created. [ 602.789132] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 602.789132] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 602.789132] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 602.789132] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 602.789132] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 602.789458] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "port-43a92dae-5096-4758-8b46-ace29582dad4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.239413] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbf0de02-2c4b-4156-ae88-4a3e624f550d taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.239763] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbf0de02-2c4b-4156-ae88-4a3e624f550d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.240486] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbf0de02-2c4b-4156-ae88-4a3e624f550d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.240625] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbf0de02-2c4b-4156-ae88-4a3e624f550d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.240817] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.240938] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.240996] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.241181] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.241272] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.241365] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbf0de02-2c4b-4156-ae88-4a3e624f550d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.241518] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbf0de02-2c4b-4156-ae88-4a3e624f550d taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.241613] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbf0de02-2c4b-4156-ae88-4a3e624f550d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.241676] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbf0de02-2c4b-4156-ae88-4a3e624f550d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.241821] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbf0de02-2c4b-4156-ae88-4a3e624f550d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.241961] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.242068] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.242130] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.242270] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.242346] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.242425] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbf0de02-2c4b-4156-ae88-4a3e624f550d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.242514] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fbf0de02-2c4b-4156-ae88-4a3e624f550d',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.319175] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0d0028b4-3629-4ade-8832-b0fbfb48d140 in Status: SUCCESS [ 603.319505] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0d0028b4-3629-4ade-8832-b0fbfb48d140" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.503815] env[67094]: INFO networking_nsxv3.common.synchronization [req-900cd0fa-29a5-4b86-b782-f362bf1fcc7a req-88fad88b-20a6-4c32-a90d-0cdc46e27c9a service nova] Enqueued Resource ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 with Priority: HIGHEST for action security_group_rules [ 603.503993] env[67094]: INFO networking_nsxv3.common.synchronization [req-900cd0fa-29a5-4b86-b782-f362bf1fcc7a req-88fad88b-20a6-4c32-a90d-0cdc46e27c9a service nova] Enqueued Resource ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 with Priority: HIGHEST for action security_group_members [ 603.504180] env[67094]: INFO networking_nsxv3.common.synchronization [req-900cd0fa-29a5-4b86-b782-f362bf1fcc7a req-88fad88b-20a6-4c32-a90d-0cdc46e27c9a service nova] Enqueued Resource ID: 43a92dae-5096-4758-8b46-ace29582dad4 with Priority: HIGHEST for action port [ 603.504776] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 with Priority: HIGHEST for action security_group_rules [ 603.504985] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 with Priority: HIGHEST for action security_group_members [ 603.505334] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43a92dae-5096-4758-8b46-ace29582dad4 with Priority: HIGHEST for action port [ 603.505722] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9f15f829-bf18-4bc7-bdf2-32c359ef7028 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.505864] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.505934] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.506220] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.506312] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9f15f829-bf18-4bc7-bdf2-32c359ef7028',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.507280] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f15f829-bf18-4bc7-bdf2-32c359ef7028 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.507390] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.507461] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.507671] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.507833] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.507957] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.508029] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.508189] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.508275] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.508368] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f15f829-bf18-4bc7-bdf2-32c359ef7028',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.510311] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-43a92dae-5096-4758-8b46-ace29582dad4 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.510422] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-43a92dae-5096-4758-8b46-ace29582dad4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.510488] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-43a92dae-5096-4758-8b46-ace29582dad4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.510743] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-43a92dae-5096-4758-8b46-ace29582dad4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.510779] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43a92dae-5096-4758-8b46-ace29582dad4',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 603.745928] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fbf0de02-2c4b-4156-ae88-4a3e624f550d: rpc.has_security_group_logging(os_id): False [ 603.766741] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.766741] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.766741] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.766741] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.767139] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.767139] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.767233] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.767233] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.767407] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.767486] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.767693] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.767956] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.768141] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.768324] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.768403] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.769156] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.769793] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.769793] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.769793] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.769793] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.769994] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fbf0de02-2c4b-4156-ae88-4a3e624f550d is going to be created. [ 603.855326] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 603.855516] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 603.855581] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 603.855738] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 603.855920] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 603.869714] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fbf0de02-2c4b-4156-ae88-4a3e624f550d in Status: IN_PROGRESS for 2s [ 604.010896] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9f15f829-bf18-4bc7-bdf2-32c359ef7028',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.013192] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f15f829-bf18-4bc7-bdf2-32c359ef7028 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.013311] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.014409] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 43a92dae-5096-4758-8b46-ace29582dad4 with status ACTIVE [ 604.014678] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.014819] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.014931] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.015244] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.015362] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.015580] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.015682] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.015823] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.015943] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.016293] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.016402] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.016534] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.016609] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.016770] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.016862] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.017072] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 43a92dae-5096-4758-8b46-ace29582dad4 is going to be updated. [ 604.041946] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.041946] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.041946] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.042196] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.045046] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.045046] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-43a92dae-5096-4758-8b46-ace29582dad4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.162806] env[67094]: INFO networking_nsxv3.common.synchronization [None req-ae55b985-204f-48c1-93d9-2e5dcd113486 None None] Enqueued Resource ID: e4be3e39-0d7e-4a24-acae-b3520f7218f2 with Priority: HIGHEST for action port [ 604.163422] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4be3e39-0d7e-4a24-acae-b3520f7218f2 with Priority: HIGHEST for action port [ 604.163709] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-e4be3e39-0d7e-4a24-acae-b3520f7218f2 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.165938] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e4be3e39-0d7e-4a24-acae-b3520f7218f2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.166025] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e4be3e39-0d7e-4a24-acae-b3520f7218f2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.166285] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e4be3e39-0d7e-4a24-acae-b3520f7218f2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.167071] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e4be3e39-0d7e-4a24-acae-b3520f7218f2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.355671] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock network-238 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.356043] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "network-238" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.356043] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "network-238" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.356318] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "network-238" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.356582] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.356772] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.356891] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.357189] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.357330] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.357528] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 604.357633] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 604.357742] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 604.357918] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 604.358075] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 604.358234] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 604.358322] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 604.381756] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 604.381946] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 604.382100] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 604.382356] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "network-238" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.382691] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock port-5d9266ef-c259-4bc5-93b3-c0bdd5b12eeb taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.382933] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "port-5d9266ef-c259-4bc5-93b3-c0bdd5b12eeb" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.383117] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "port-5d9266ef-c259-4bc5-93b3-c0bdd5b12eeb" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.383475] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "port-5d9266ef-c259-4bc5-93b3-c0bdd5b12eeb" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.383647] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d9266ef-c259-4bc5-93b3-c0bdd5b12eeb',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.517954] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9f15f829-bf18-4bc7-bdf2-32c359ef7028',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.533629] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c6a3072-604c-444a-b4d4-9ed06e060bef in Status: SUCCESS [ 604.533863] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c6a3072-604c-444a-b4d4-9ed06e060bef" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.534345] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c6a3072-604c-444a-b4d4-9ed06e060bef" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.534572] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c6a3072-604c-444a-b4d4-9ed06e060bef" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.534825] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.534946] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.535052] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.535221] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.535309] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.535397] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c6a3072-604c-444a-b4d4-9ed06e060bef" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.535486] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0c6a3072-604c-444a-b4d4-9ed06e060bef',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 604.670256] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e4be3e39-0d7e-4a24-acae-b3520f7218f2 [ 604.670597] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.670768] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.670845] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.671096] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.671208] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.671309] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e4be3e39-0d7e-4a24-acae-b3520f7218f2 already deleted. [ 604.671398] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e4be3e39-0d7e-4a24-acae-b3520f7218f2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.888063] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.891172] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.891172] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.891172] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.891172] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.891172] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Segment Port 5d9266ef-c259-4bc5-93b3-c0bdd5b12eeb not found, creating... [ 604.891172] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.891172] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.891172] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.891172] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.891172] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.891671] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.891671] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.891671] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.892455] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.892769] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.893134] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Resource: SegmentPort with ID: 5d9266ef-c259-4bc5-93b3-c0bdd5b12eeb is going to be created. [ 604.948054] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 604.948054] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 604.948054] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 604.948314] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 604.948465] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 604.948687] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "port-5d9266ef-c259-4bc5-93b3-c0bdd5b12eeb" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.019407] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.019407] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.019523] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.020079] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.020079] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.020079] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 is going to be created. [ 605.037214] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0c6a3072-604c-444a-b4d4-9ed06e060bef',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.069282] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.069282] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.069282] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.069282] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.069282] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.081930] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 in Status: UNINITIALIZED for 2s [ 605.541471] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0c6a3072-604c-444a-b4d4-9ed06e060bef: rpc.has_security_group_logging(os_id): False [ 605.561702] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.561926] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.562008] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.562230] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.562326] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.562578] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.562677] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.562742] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.562878] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.562950] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.563043] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0c6a3072-604c-444a-b4d4-9ed06e060bef is going to be created. [ 605.648842] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.648997] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.649077] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.649680] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.649680] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 605.663376] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c6a3072-604c-444a-b4d4-9ed06e060bef in Status: IN_PROGRESS for 2s [ 605.758057] env[67094]: INFO networking_nsxv3.common.synchronization [req-900cd0fa-29a5-4b86-b782-f362bf1fcc7a req-973b8564-59e5-4dea-b45d-325190f45608 service nova] Enqueued Resource ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 with Priority: HIGHEST for action security_group_rules [ 605.758179] env[67094]: INFO networking_nsxv3.common.synchronization [req-900cd0fa-29a5-4b86-b782-f362bf1fcc7a req-973b8564-59e5-4dea-b45d-325190f45608 service nova] Enqueued Resource ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 with Priority: HIGHEST for action security_group_members [ 605.758279] env[67094]: INFO networking_nsxv3.common.synchronization [req-900cd0fa-29a5-4b86-b782-f362bf1fcc7a req-973b8564-59e5-4dea-b45d-325190f45608 service nova] Enqueued Resource ID: 5d9266ef-c259-4bc5-93b3-c0bdd5b12eeb with Priority: HIGHEST for action port [ 605.758519] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 with Priority: HIGHEST for action security_group_rules [ 605.758650] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 with Priority: HIGHEST for action security_group_members [ 605.758762] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d9266ef-c259-4bc5-93b3-c0bdd5b12eeb with Priority: HIGHEST for action port [ 605.759416] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9f15f829-bf18-4bc7-bdf2-32c359ef7028 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.759527] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.759724] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f15f829-bf18-4bc7-bdf2-32c359ef7028 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.759810] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.759984] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-5d9266ef-c259-4bc5-93b3-c0bdd5b12eeb taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 605.760105] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5d9266ef-c259-4bc5-93b3-c0bdd5b12eeb" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 605.760238] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5d9266ef-c259-4bc5-93b3-c0bdd5b12eeb" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 605.760399] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5d9266ef-c259-4bc5-93b3-c0bdd5b12eeb" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 605.760482] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5d9266ef-c259-4bc5-93b3-c0bdd5b12eeb',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 605.888597] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fbf0de02-2c4b-4156-ae88-4a3e624f550d in Status: SUCCESS [ 605.888597] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fbf0de02-2c4b-4156-ae88-4a3e624f550d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.267471] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5d9266ef-c259-4bc5-93b3-c0bdd5b12eeb with status ACTIVE [ 606.267471] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.267471] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.267471] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.267471] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.267471] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.267471] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.267471] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.267471] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.267471] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.267471] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.267471] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.267471] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.267471] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.267471] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.267471] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.267471] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5d9266ef-c259-4bc5-93b3-c0bdd5b12eeb is going to be updated. [ 606.317359] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.317533] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.317605] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.318140] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.318311] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.318501] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5d9266ef-c259-4bc5-93b3-c0bdd5b12eeb" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.445987] env[67094]: INFO networking_nsxv3.common.synchronization [None req-7c2222c8-933d-4805-a2dd-ee847cbbadaa None None] Enqueued Resource ID: 54ce2a47-b3b9-4351-94e6-1ef51e776c29 with Priority: HIGHEST for action port [ 606.447732] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 54ce2a47-b3b9-4351-94e6-1ef51e776c29 with Priority: HIGHEST for action port [ 606.450712] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-54ce2a47-b3b9-4351-94e6-1ef51e776c29 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.450712] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-54ce2a47-b3b9-4351-94e6-1ef51e776c29" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.450712] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-54ce2a47-b3b9-4351-94e6-1ef51e776c29" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.450712] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-54ce2a47-b3b9-4351-94e6-1ef51e776c29" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.450712] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('54ce2a47-b3b9-4351-94e6-1ef51e776c29',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.536472] env[67094]: INFO networking_nsxv3.common.synchronization [req-fd503c96-8d9e-40c0-bd71-30d5009b60ae req-92cb9fff-36d7-40db-a29d-fb6388002345 tempest-VolumesAssistedSnapshotsTest-1350353743 tempest-VolumesAssistedSnapshotsTest-1350353743-project-member] Enqueued Resource ID: f71d6693-6145-4241-b055-f03e34f73c7f with Priority: HIGHEST for action security_group_members [ 606.536544] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f71d6693-6145-4241-b055-f03e34f73c7f with Priority: HIGHEST for action security_group_members [ 606.536974] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-f71d6693-6145-4241-b055-f03e34f73c7f taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.537607] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f71d6693-6145-4241-b055-f03e34f73c7f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.537847] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f71d6693-6145-4241-b055-f03e34f73c7f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.538357] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f71d6693-6145-4241-b055-f03e34f73c7f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.538510] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.538776] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.538776] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.539148] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.539148] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.539875] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f71d6693-6145-4241-b055-f03e34f73c7f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.787292] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock network-560 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.787618] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "network-560" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.787970] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "network-560" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.787970] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "network-560" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.788254] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.788423] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.788598] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.788772] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.788914] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.789121] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 606.789228] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 606.789346] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 606.789467] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 606.789575] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 606.789673] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 606.790219] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 606.809724] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 606.809942] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 606.810071] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 606.810254] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "network-560" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.810558] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock port-e5835d4b-8a50-46a3-8afd-d440b5a76d66 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.810724] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "port-e5835d4b-8a50-46a3-8afd-d440b5a76d66" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.810842] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "port-e5835d4b-8a50-46a3-8afd-d440b5a76d66" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.811176] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "port-e5835d4b-8a50-46a3-8afd-d440b5a76d66" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.811314] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5835d4b-8a50-46a3-8afd-d440b5a76d66',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 606.957776] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 54ce2a47-b3b9-4351-94e6-1ef51e776c29 [ 606.957776] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 606.957776] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 606.957776] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 606.957776] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 606.957776] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 606.957776] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:54ce2a47-b3b9-4351-94e6-1ef51e776c29 already deleted. [ 606.957776] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-54ce2a47-b3b9-4351-94e6-1ef51e776c29" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.043360] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.043669] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.043669] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.043772] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.043772] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.043966] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.044078] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.044138] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.044302] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.044354] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.044579] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f71d6693-6145-4241-b055-f03e34f73c7f already deleted. [ 607.044579] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f71d6693-6145-4241-b055-f03e34f73c7f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.095896] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 in Status: SUCCESS [ 607.096251] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.096359] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.096831] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.096831] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.096981] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.096981] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.097144] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.097354] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.097354] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.097452] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9f15f829-bf18-4bc7-bdf2-32c359ef7028',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.100107] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.100107] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.100341] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.100341] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.100341] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.100483] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.100568] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.100687] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f15f829-bf18-4bc7-bdf2-32c359ef7028',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.265966] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock network-835 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.266184] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "network-835" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.266316] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "network-835" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.266613] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "network-835" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.266923] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.267104] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.267219] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.267516] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.267800] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.268049] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 607.268229] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 607.268398] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 607.268543] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 607.268692] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 607.268824] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 607.268954] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 607.301280] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 607.301476] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Cache value generated in 0.032 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 607.301648] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 607.301842] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "network-835" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.302394] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock port-f079c4c0-8a2d-4375-8df3-4850377b9d86 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.302692] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "port-f079c4c0-8a2d-4375-8df3-4850377b9d86" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.302849] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "port-f079c4c0-8a2d-4375-8df3-4850377b9d86" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.303628] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "port-f079c4c0-8a2d-4375-8df3-4850377b9d86" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.303773] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f079c4c0-8a2d-4375-8df3-4850377b9d86',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.314716] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.315190] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.315401] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.315868] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.316165] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.316486] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Segment Port e5835d4b-8a50-46a3-8afd-d440b5a76d66 not found, creating... [ 607.317370] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.317370] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.317370] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.317635] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.317800] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.318198] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.319027] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.319027] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.319027] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.319027] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.319306] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Resource: SegmentPort with ID: e5835d4b-8a50-46a3-8afd-d440b5a76d66 is going to be created. [ 607.360185] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.360185] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.360185] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.360185] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.360185] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.360438] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "port-e5835d4b-8a50-46a3-8afd-d440b5a76d66" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.602820] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f15f829-bf18-4bc7-bdf2-32c359ef7028 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.602992] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.604379] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9f15f829-bf18-4bc7-bdf2-32c359ef7028',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 607.675277] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0c6a3072-604c-444a-b4d4-9ed06e060bef in Status: SUCCESS [ 607.675458] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0c6a3072-604c-444a-b4d4-9ed06e060bef" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.807261] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.807683] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.807683] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.807976] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.808196] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.808297] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Segment Port f079c4c0-8a2d-4375-8df3-4850377b9d86 not found, creating... [ 607.808559] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.808720] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.808834] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.809078] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.809212] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.809488] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.809641] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.809752] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.809957] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.810104] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.810235] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Resource: SegmentPort with ID: f079c4c0-8a2d-4375-8df3-4850377b9d86 is going to be created. [ 607.830679] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 607.830896] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 607.830991] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 607.831289] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 607.831509] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 607.831727] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "port-f079c4c0-8a2d-4375-8df3-4850377b9d86" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.074321] env[67094]: INFO networking_nsxv3.common.synchronization [req-900cd0fa-29a5-4b86-b782-f362bf1fcc7a req-c04717c3-39b6-43f7-a8ab-2a1042681276 service nova] Enqueued Resource ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 with Priority: HIGHEST for action security_group_rules [ 608.074680] env[67094]: INFO networking_nsxv3.common.synchronization [req-900cd0fa-29a5-4b86-b782-f362bf1fcc7a req-c04717c3-39b6-43f7-a8ab-2a1042681276 service nova] Enqueued Resource ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 with Priority: HIGHEST for action security_group_members [ 608.074680] env[67094]: INFO networking_nsxv3.common.synchronization [req-900cd0fa-29a5-4b86-b782-f362bf1fcc7a req-c04717c3-39b6-43f7-a8ab-2a1042681276 service nova] Enqueued Resource ID: e5835d4b-8a50-46a3-8afd-d440b5a76d66 with Priority: HIGHEST for action port [ 608.074881] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 with Priority: HIGHEST for action security_group_rules [ 608.075077] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 with Priority: HIGHEST for action security_group_members [ 608.075198] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e5835d4b-8a50-46a3-8afd-d440b5a76d66 with Priority: HIGHEST for action port [ 608.075797] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9f15f829-bf18-4bc7-bdf2-32c359ef7028 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.075930] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.076361] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f15f829-bf18-4bc7-bdf2-32c359ef7028 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.078134] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.078134] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-e5835d4b-8a50-46a3-8afd-d440b5a76d66 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.078134] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e5835d4b-8a50-46a3-8afd-d440b5a76d66" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.078134] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e5835d4b-8a50-46a3-8afd-d440b5a76d66" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.078349] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e5835d4b-8a50-46a3-8afd-d440b5a76d66" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.078349] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e5835d4b-8a50-46a3-8afd-d440b5a76d66',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.107464] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9f15f829-bf18-4bc7-bdf2-32c359ef7028',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.574079] env[67094]: INFO networking_nsxv3.common.synchronization [req-fd503c96-8d9e-40c0-bd71-30d5009b60ae req-b1406ace-9b32-47ad-bf26-a810257b2276 service nova] Enqueued Resource ID: f71d6693-6145-4241-b055-f03e34f73c7f with Priority: HIGHEST for action security_group_rules [ 608.574079] env[67094]: INFO networking_nsxv3.common.synchronization [req-fd503c96-8d9e-40c0-bd71-30d5009b60ae req-b1406ace-9b32-47ad-bf26-a810257b2276 service nova] Enqueued Resource ID: f71d6693-6145-4241-b055-f03e34f73c7f with Priority: HIGHEST for action security_group_members [ 608.574079] env[67094]: INFO networking_nsxv3.common.synchronization [req-fd503c96-8d9e-40c0-bd71-30d5009b60ae req-b1406ace-9b32-47ad-bf26-a810257b2276 service nova] Enqueued Resource ID: f079c4c0-8a2d-4375-8df3-4850377b9d86 with Priority: HIGHEST for action port [ 608.574299] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f71d6693-6145-4241-b055-f03e34f73c7f with Priority: HIGHEST for action security_group_rules [ 608.574769] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f71d6693-6145-4241-b055-f03e34f73c7f with Priority: HIGHEST for action security_group_members [ 608.574884] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f079c4c0-8a2d-4375-8df3-4850377b9d86 with Priority: HIGHEST for action port [ 608.575237] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f71d6693-6145-4241-b055-f03e34f73c7f taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.575510] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f71d6693-6145-4241-b055-f03e34f73c7f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.575510] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f71d6693-6145-4241-b055-f03e34f73c7f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.575767] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f71d6693-6145-4241-b055-f03e34f73c7f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.575767] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f71d6693-6145-4241-b055-f03e34f73c7f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.578726] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-f71d6693-6145-4241-b055-f03e34f73c7f taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.578726] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f71d6693-6145-4241-b055-f03e34f73c7f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.578726] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f71d6693-6145-4241-b055-f03e34f73c7f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.578726] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f71d6693-6145-4241-b055-f03e34f73c7f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.578726] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.578726] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.578726] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.578726] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.578726] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.578726] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f71d6693-6145-4241-b055-f03e34f73c7f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.579536] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-f079c4c0-8a2d-4375-8df3-4850377b9d86 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.579536] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f079c4c0-8a2d-4375-8df3-4850377b9d86" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.579536] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f079c4c0-8a2d-4375-8df3-4850377b9d86" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.579957] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f079c4c0-8a2d-4375-8df3-4850377b9d86" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.579957] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f079c4c0-8a2d-4375-8df3-4850377b9d86',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 608.582205] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e5835d4b-8a50-46a3-8afd-d440b5a76d66 with status ACTIVE [ 608.583292] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.583354] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.583424] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.583601] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.583657] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.584353] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.584353] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.584353] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.584353] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.584353] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.584669] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.584669] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.584669] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.584790] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.584864] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.584895] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e5835d4b-8a50-46a3-8afd-d440b5a76d66 is going to be updated. [ 608.611500] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.611500] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.611500] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.611500] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.611500] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.611500] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 is going to be updated. [ 608.613135] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.613135] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.613135] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.613135] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.613135] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.613421] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e5835d4b-8a50-46a3-8afd-d440b5a76d66" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.690059] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 608.690791] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 608.690936] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 608.691210] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 608.691371] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 608.706133] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 in Status: IN_PROGRESS for 2s [ 609.084340] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-f71d6693-6145-4241-b055-f03e34f73c7f taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.084340] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f71d6693-6145-4241-b055-f03e34f73c7f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.084340] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f71d6693-6145-4241-b055-f03e34f73c7f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.087489] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f079c4c0-8a2d-4375-8df3-4850377b9d86 with status ACTIVE [ 609.091519] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.091519] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.091519] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.091519] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.091519] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.091519] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.091519] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.091519] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.091519] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.091519] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.091519] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.091519] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.091519] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.091519] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.091519] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.091519] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f079c4c0-8a2d-4375-8df3-4850377b9d86 is going to be updated. [ 609.112698] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.112698] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.112698] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.112698] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.112698] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.112698] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f079c4c0-8a2d-4375-8df3-4850377b9d86" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.170692] env[67094]: INFO networking_nsxv3.common.synchronization [req-fa872334-97a6-4545-b3cc-8d9f0ddca3f4 req-3394aeb5-ab3d-474d-b7f6-e1ba81cb2b4e tempest-ServerMetadataTestJSON-916132385 tempest-ServerMetadataTestJSON-916132385-project-member] Enqueued Resource ID: 4e31526a-4068-4c26-bce5-72c9c1c3964e with Priority: HIGHEST for action security_group_members [ 609.170692] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e31526a-4068-4c26-bce5-72c9c1c3964e with Priority: HIGHEST for action security_group_members [ 609.170767] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e31526a-4068-4c26-bce5-72c9c1c3964e taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.171347] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e31526a-4068-4c26-bce5-72c9c1c3964e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.171508] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e31526a-4068-4c26-bce5-72c9c1c3964e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.172029] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e31526a-4068-4c26-bce5-72c9c1c3964e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.172262] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.172477] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.172634] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.172914] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.173104] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.173691] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e31526a-4068-4c26-bce5-72c9c1c3964e',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.586893] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f71d6693-6145-4241-b055-f03e34f73c7f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 609.678252] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.679556] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.679663] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.679933] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.680066] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.680292] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.680444] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.680483] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.680656] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.680734] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.680823] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e31526a-4068-4c26-bce5-72c9c1c3964e already deleted. [ 609.680938] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e31526a-4068-4c26-bce5-72c9c1c3964e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.920400] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock network-295 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.920639] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "network-295" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.921445] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "network-295" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.921445] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "network-295" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.921445] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.922714] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.922714] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.922714] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.922714] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.923141] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 609.923141] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 609.923250] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 609.923427] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 609.923580] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 609.923770] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 609.924046] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 609.961701] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 609.962159] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Cache value generated in 0.038 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 609.962313] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 609.962593] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "network-295" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 609.963082] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock port-b6f15142-d221-4317-966e-73e106134b45 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 609.963353] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "port-b6f15142-d221-4317-966e-73e106134b45" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 609.963549] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "port-b6f15142-d221-4317-966e-73e106134b45" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 609.964651] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "port-b6f15142-d221-4317-966e-73e106134b45" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 609.964651] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b6f15142-d221-4317-966e-73e106134b45',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.089239] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.089633] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.089633] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.089889] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.090043] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.090120] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f71d6693-6145-4241-b055-f03e34f73c7f is going to be created. [ 610.136423] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.136646] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.136703] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.136976] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.137154] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.148615] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f71d6693-6145-4241-b055-f03e34f73c7f in Status: UNINITIALIZED for 2s [ 610.473803] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.473803] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.473803] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.473803] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.473803] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.473803] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Segment Port b6f15142-d221-4317-966e-73e106134b45 not found, creating... [ 610.473803] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.473803] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.473803] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.473803] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.473803] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.474278] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.474278] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.475072] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.476101] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.476101] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.476101] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Resource: SegmentPort with ID: b6f15142-d221-4317-966e-73e106134b45 is going to be created. [ 610.497556] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.497762] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.497876] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.498196] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.498447] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.498663] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "port-b6f15142-d221-4317-966e-73e106134b45" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.718249] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 in Status: SUCCESS [ 610.718496] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.718660] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.718884] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.719121] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.719309] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.719351] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.719486] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.719618] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.719774] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.720072] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f15f829-bf18-4bc7-bdf2-32c359ef7028 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.720228] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.720305] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.720913] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.721063] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.721256] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.721370] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.721585] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.721721] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.721829] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.721950] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9f15f829-bf18-4bc7-bdf2-32c359ef7028',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.723377] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.723611] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.723787] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.723936] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.723993] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.724111] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.724271] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 610.724422] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f15f829-bf18-4bc7-bdf2-32c359ef7028',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 610.978799] env[67094]: INFO networking_nsxv3.common.synchronization [None req-6931d3b9-72a9-431a-81d6-92d6e15fbc08 None None] Enqueued Resource ID: 31d5d47e-3b90-417b-a051-7545a91a3ff7 with Priority: HIGHEST for action port [ 610.979483] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31d5d47e-3b90-417b-a051-7545a91a3ff7 with Priority: HIGHEST for action port [ 610.979867] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-31d5d47e-3b90-417b-a051-7545a91a3ff7 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 610.980058] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31d5d47e-3b90-417b-a051-7545a91a3ff7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 610.980058] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31d5d47e-3b90-417b-a051-7545a91a3ff7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 610.981569] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31d5d47e-3b90-417b-a051-7545a91a3ff7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 610.981668] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31d5d47e-3b90-417b-a051-7545a91a3ff7',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.226822] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9f15f829-bf18-4bc7-bdf2-32c359ef7028: rpc.has_security_group_logging(os_id): False [ 611.228213] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9f15f829-bf18-4bc7-bdf2-32c359ef7028',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.251849] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.252171] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.252171] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.252289] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.252594] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.252594] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.252869] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.252969] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.253148] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.253299] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.253472] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.253568] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.253620] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.253793] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.253864] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.254135] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.254242] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.254297] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.254437] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.254509] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.254590] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 is going to be created. [ 611.328028] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.328028] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.328028] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.328028] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.328028] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.345492] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 in Status: IN_PROGRESS for 2s [ 611.485106] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 31d5d47e-3b90-417b-a051-7545a91a3ff7 [ 611.485316] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.485409] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.485466] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.485703] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.485813] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.485912] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:31d5d47e-3b90-417b-a051-7545a91a3ff7 already deleted. [ 611.485992] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31d5d47e-3b90-417b-a051-7545a91a3ff7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.528995] env[67094]: INFO networking_nsxv3.common.synchronization [req-fa872334-97a6-4545-b3cc-8d9f0ddca3f4 req-33409177-e5b0-4176-b354-01dd049b81f7 service nova] Enqueued Resource ID: 4e31526a-4068-4c26-bce5-72c9c1c3964e with Priority: HIGHEST for action security_group_rules [ 611.529252] env[67094]: INFO networking_nsxv3.common.synchronization [req-fa872334-97a6-4545-b3cc-8d9f0ddca3f4 req-33409177-e5b0-4176-b354-01dd049b81f7 service nova] Enqueued Resource ID: 4e31526a-4068-4c26-bce5-72c9c1c3964e with Priority: HIGHEST for action security_group_members [ 611.529361] env[67094]: INFO networking_nsxv3.common.synchronization [req-fa872334-97a6-4545-b3cc-8d9f0ddca3f4 req-33409177-e5b0-4176-b354-01dd049b81f7 service nova] Enqueued Resource ID: b6f15142-d221-4317-966e-73e106134b45 with Priority: HIGHEST for action port [ 611.529539] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e31526a-4068-4c26-bce5-72c9c1c3964e with Priority: HIGHEST for action security_group_rules [ 611.529667] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e31526a-4068-4c26-bce5-72c9c1c3964e with Priority: HIGHEST for action security_group_members [ 611.529764] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b6f15142-d221-4317-966e-73e106134b45 with Priority: HIGHEST for action port [ 611.530544] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4e31526a-4068-4c26-bce5-72c9c1c3964e taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.530544] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4e31526a-4068-4c26-bce5-72c9c1c3964e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.530544] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4e31526a-4068-4c26-bce5-72c9c1c3964e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.530830] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4e31526a-4068-4c26-bce5-72c9c1c3964e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.530830] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4e31526a-4068-4c26-bce5-72c9c1c3964e',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.534318] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e31526a-4068-4c26-bce5-72c9c1c3964e taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.534440] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e31526a-4068-4c26-bce5-72c9c1c3964e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.534505] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e31526a-4068-4c26-bce5-72c9c1c3964e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.534752] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e31526a-4068-4c26-bce5-72c9c1c3964e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.534896] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.534993] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.535070] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.535223] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.535309] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 611.535407] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e31526a-4068-4c26-bce5-72c9c1c3964e',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.536192] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-b6f15142-d221-4317-966e-73e106134b45 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.536290] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b6f15142-d221-4317-966e-73e106134b45" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.536366] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b6f15142-d221-4317-966e-73e106134b45" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.536508] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b6f15142-d221-4317-966e-73e106134b45" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.536583] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b6f15142-d221-4317-966e-73e106134b45',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.733391] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9f15f829-bf18-4bc7-bdf2-32c359ef7028',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 611.760872] env[67094]: INFO networking_nsxv3.common.synchronization [None req-d8a207cd-7a86-4ffa-805e-bae3f797034b None None] Enqueued Resource ID: e907a8b1-95a1-48e2-be08-ee3e362a9f25 with Priority: HIGHEST for action port [ 611.760872] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e907a8b1-95a1-48e2-be08-ee3e362a9f25 with Priority: HIGHEST for action port [ 611.761573] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-e907a8b1-95a1-48e2-be08-ee3e362a9f25 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 611.761829] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e907a8b1-95a1-48e2-be08-ee3e362a9f25" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 611.761983] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e907a8b1-95a1-48e2-be08-ee3e362a9f25" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 611.762329] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e907a8b1-95a1-48e2-be08-ee3e362a9f25" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 611.762500] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e907a8b1-95a1-48e2-be08-ee3e362a9f25',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.044033] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4e31526a-4068-4c26-bce5-72c9c1c3964e',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.044033] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e31526a-4068-4c26-bce5-72c9c1c3964e taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.044033] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e31526a-4068-4c26-bce5-72c9c1c3964e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.044033] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b6f15142-d221-4317-966e-73e106134b45 with status ACTIVE [ 612.044033] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.044033] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.044033] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.044033] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.044033] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.044033] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.044033] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.044033] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.044033] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.044033] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.045034] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.045034] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.045034] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.045034] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.045034] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.045034] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b6f15142-d221-4317-966e-73e106134b45 is going to be updated. [ 612.094197] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.094197] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.094197] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.094197] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.094197] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.094197] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b6f15142-d221-4317-966e-73e106134b45" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.161229] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f71d6693-6145-4241-b055-f03e34f73c7f in Status: SUCCESS [ 612.162064] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f71d6693-6145-4241-b055-f03e34f73c7f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.162394] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f71d6693-6145-4241-b055-f03e34f73c7f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.162711] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f71d6693-6145-4241-b055-f03e34f73c7f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.163017] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.163263] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.163418] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.163677] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.163859] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.164050] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f71d6693-6145-4241-b055-f03e34f73c7f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.165025] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f71d6693-6145-4241-b055-f03e34f73c7f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.237367] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.237367] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.237656] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.238024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.238024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.238024] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 is going to be updated. [ 612.266266] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e907a8b1-95a1-48e2-be08-ee3e362a9f25 [ 612.266266] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.266266] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.266266] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.266266] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.266266] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.266266] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e907a8b1-95a1-48e2-be08-ee3e362a9f25 already deleted. [ 612.266266] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e907a8b1-95a1-48e2-be08-ee3e362a9f25" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.280214] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.280214] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.280214] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.280214] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.280214] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.309969] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 in Status: IN_PROGRESS for 2s [ 612.555148] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4e31526a-4068-4c26-bce5-72c9c1c3964e',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.576303] env[67094]: INFO networking_nsxv3.common.synchronization [None req-dd8fd3c9-d609-48c4-84a1-b02bef83cf75 tempest-ServerActionsTestJSON-785713127 tempest-ServerActionsTestJSON-785713127-project-member] Enqueued Resource ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 with Priority: HIGHEST for action security_group_rules [ 612.576979] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 with Priority: HIGHEST for action security_group_rules [ 612.577555] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-018c19d8-0b0e-41bd-8f01-0c9c58710c57 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.579510] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.579510] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.579510] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.579657] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('018c19d8-0b0e-41bd-8f01-0c9c58710c57',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.666844] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f71d6693-6145-4241-b055-f03e34f73c7f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 612.894952] env[67094]: INFO networking_nsxv3.common.synchronization [req-5b43d6a7-2f63-4eb3-b62a-4107cd4ac13e req-d0a00831-a1e3-49d0-ac0a-043ddee5fbbb tempest-ImagesNegativeTestJSON-679585558 tempest-ImagesNegativeTestJSON-679585558-project-member] Enqueued Resource ID: a5894e01-0dd0-4818-929b-f9f643fa6db0 with Priority: HIGHEST for action security_group_members [ 612.894952] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5894e01-0dd0-4818-929b-f9f643fa6db0 with Priority: HIGHEST for action security_group_members [ 612.894952] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5894e01-0dd0-4818-929b-f9f643fa6db0 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.895156] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5894e01-0dd0-4818-929b-f9f643fa6db0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.895156] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5894e01-0dd0-4818-929b-f9f643fa6db0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.895669] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5894e01-0dd0-4818-929b-f9f643fa6db0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.895669] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 612.895669] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 612.896069] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 612.896162] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 612.896162] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 612.896264] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5894e01-0dd0-4818-929b-f9f643fa6db0',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.060466] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.060466] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.060466] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.060466] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.060466] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.060466] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e31526a-4068-4c26-bce5-72c9c1c3964e is going to be created. [ 613.104937] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.104937] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.104937] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.104937] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.104937] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.104937] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 already deleted. [ 613.104937] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.104937] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.104937] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.104937] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.104937] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.104937] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.117951] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e31526a-4068-4c26-bce5-72c9c1c3964e in Status: UNINITIALIZED for 2s [ 613.172014] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f71d6693-6145-4241-b055-f03e34f73c7f: rpc.has_security_group_logging(os_id): False [ 613.175745] env[67094]: INFO networking_nsxv3.common.synchronization [None req-e90317d1-3811-4beb-a684-ba3708130bc6 None None] Enqueued Resource ID: 8be92143-53c8-4656-b3ef-8176940bffe0 with Priority: HIGHEST for action port [ 613.177825] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8be92143-53c8-4656-b3ef-8176940bffe0 with Priority: HIGHEST for action port [ 613.177825] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-8be92143-53c8-4656-b3ef-8176940bffe0 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.177825] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8be92143-53c8-4656-b3ef-8176940bffe0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.177825] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8be92143-53c8-4656-b3ef-8176940bffe0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.177825] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8be92143-53c8-4656-b3ef-8176940bffe0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.177825] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8be92143-53c8-4656-b3ef-8176940bffe0',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.209497] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.212021] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.212021] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.212021] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.212021] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.212021] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.212021] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.212021] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.212021] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.212021] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.212021] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f71d6693-6145-4241-b055-f03e34f73c7f is going to be created. [ 613.312764] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.312764] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.312764] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.312764] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.312764] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.325468] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f71d6693-6145-4241-b055-f03e34f73c7f in Status: IN_PROGRESS for 2s [ 613.340884] env[67094]: INFO networking_nsxv3.common.synchronization [None req-72517c4f-5ea8-4732-8140-e3c189b80716 None None] Enqueued Resource ID: a9b7b892-1786-4023-9ee4-31cdd0d0e674 with Priority: HIGHEST for action port [ 613.340884] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9b7b892-1786-4023-9ee4-31cdd0d0e674 with Priority: HIGHEST for action port [ 613.340884] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-a9b7b892-1786-4023-9ee4-31cdd0d0e674 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.340884] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a9b7b892-1786-4023-9ee4-31cdd0d0e674" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.340884] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a9b7b892-1786-4023-9ee4-31cdd0d0e674" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.340884] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a9b7b892-1786-4023-9ee4-31cdd0d0e674" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.341434] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a9b7b892-1786-4023-9ee4-31cdd0d0e674',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.358722] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 in Status: SUCCESS [ 613.358951] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.359100] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.359305] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.359392] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9f15f829-bf18-4bc7-bdf2-32c359ef7028',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.399274] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.399274] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.399274] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.399274] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.399649] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.399649] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.399733] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.399733] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.399922] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.400013] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.400054] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5894e01-0dd0-4818-929b-f9f643fa6db0 already deleted. [ 613.400134] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5894e01-0dd0-4818-929b-f9f643fa6db0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.541320] env[67094]: INFO networking_nsxv3.common.synchronization [None req-9db2f117-8063-4dd5-9a7b-b84e2373a5d9 tempest-ServerActionsTestJSON-785713127 tempest-ServerActionsTestJSON-785713127-project-member] Enqueued Resource ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 with Priority: HIGHEST for action security_group_rules [ 613.541746] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 with Priority: HIGHEST for action security_group_rules [ 613.542066] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-018c19d8-0b0e-41bd-8f01-0c9c58710c57 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.542193] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.542288] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.542515] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.542603] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('018c19d8-0b0e-41bd-8f01-0c9c58710c57',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.680727] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8be92143-53c8-4656-b3ef-8176940bffe0 [ 613.682050] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.685153] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.685153] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.685153] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.685153] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.685153] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8be92143-53c8-4656-b3ef-8176940bffe0 already deleted. [ 613.685153] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8be92143-53c8-4656-b3ef-8176940bffe0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.827964] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock network-774 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.827964] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "network-774" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.827964] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "network-774" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.827964] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "network-774" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.827964] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.827964] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.827964] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.832106] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.832106] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.832106] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 613.832106] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 613.832106] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 613.832106] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 613.832106] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 613.832106] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 613.832106] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 613.844448] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a9b7b892-1786-4023-9ee4-31cdd0d0e674 [ 613.845079] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.845079] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.845079] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.845340] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.845340] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.845340] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a9b7b892-1786-4023-9ee4-31cdd0d0e674 already deleted. [ 613.845340] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a9b7b892-1786-4023-9ee4-31cdd0d0e674" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.854581] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 613.854767] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 613.854911] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 613.855137] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "network-774" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 613.855462] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock port-0ac13e6f-08b8-4e6d-b020-f9bf11a96d5f taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.855635] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "port-0ac13e6f-08b8-4e6d-b020-f9bf11a96d5f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 613.855747] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "port-0ac13e6f-08b8-4e6d-b020-f9bf11a96d5f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 613.856078] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "port-0ac13e6f-08b8-4e6d-b020-f9bf11a96d5f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 613.856252] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ac13e6f-08b8-4e6d-b020-f9bf11a96d5f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 613.863132] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f15f829-bf18-4bc7-bdf2-32c359ef7028 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 613.863256] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.070603] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.070603] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.070603] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.070603] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.070603] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.070603] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 already deleted. [ 614.070603] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.279269] env[67094]: INFO networking_nsxv3.common.synchronization [None req-846199ce-ab5b-40da-b3c0-b20b72a533ea None None] Enqueued Resource ID: c46f97a8-5b69-4eb1-a418-3cb3b6a22cad with Priority: HIGHEST for action port [ 614.279577] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c46f97a8-5b69-4eb1-a418-3cb3b6a22cad with Priority: HIGHEST for action port [ 614.280179] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-c46f97a8-5b69-4eb1-a418-3cb3b6a22cad taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.280340] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c46f97a8-5b69-4eb1-a418-3cb3b6a22cad" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.280395] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c46f97a8-5b69-4eb1-a418-3cb3b6a22cad" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.280611] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c46f97a8-5b69-4eb1-a418-3cb3b6a22cad" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.280694] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c46f97a8-5b69-4eb1-a418-3cb3b6a22cad',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.321819] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 in Status: SUCCESS [ 614.321819] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.322274] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.324096] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.324096] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.324096] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.324096] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.324096] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.324096] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.324096] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.324096] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9f15f829-bf18-4bc7-bdf2-32c359ef7028',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 614.359601] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.359819] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.359942] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.360263] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.360409] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.360557] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Segment Port 0ac13e6f-08b8-4e6d-b020-f9bf11a96d5f not found, creating... [ 614.360803] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.360953] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.361075] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.361286] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.361416] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.361681] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.361832] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.361945] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.362157] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.362313] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.362450] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Resource: SegmentPort with ID: 0ac13e6f-08b8-4e6d-b020-f9bf11a96d5f is going to be created. [ 614.382648] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.382881] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.382969] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.383261] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.383484] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.383700] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "port-0ac13e6f-08b8-4e6d-b020-f9bf11a96d5f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.788091] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port c46f97a8-5b69-4eb1-a418-3cb3b6a22cad [ 614.788272] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.788415] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.788485] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.788694] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.788784] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.788878] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:c46f97a8-5b69-4eb1-a418-3cb3b6a22cad already deleted. [ 614.788960] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c46f97a8-5b69-4eb1-a418-3cb3b6a22cad" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.826235] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f15f829-bf18-4bc7-bdf2-32c359ef7028 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.826235] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.826235] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.826235] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.826585] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.826585] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.826585] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.826753] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.826753] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.826882] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.827019] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f15f829-bf18-4bc7-bdf2-32c359ef7028 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.827114] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.827171] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.827323] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.827459] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 614.827551] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 614.827608] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 614.827937] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 614.828289] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.828289] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 614.828391] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9f15f829-bf18-4bc7-bdf2-32c359ef7028',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.056140] env[67094]: INFO networking_nsxv3.common.synchronization [req-1e8ea085-4686-461e-9093-3dfa7a779128 req-c4408ce7-2522-4a85-ba32-470d360fc6de tempest-ServersAdminNegativeTestJSON-87945101 tempest-ServersAdminNegativeTestJSON-87945101-project-member] Enqueued Resource ID: 75d792df-97d6-4e1a-bf50-631a4a868869 with Priority: HIGHEST for action security_group_members [ 615.056140] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75d792df-97d6-4e1a-bf50-631a4a868869 with Priority: HIGHEST for action security_group_members [ 615.056140] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-75d792df-97d6-4e1a-bf50-631a4a868869 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.056140] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75d792df-97d6-4e1a-bf50-631a4a868869" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.056140] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75d792df-97d6-4e1a-bf50-631a4a868869" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.056140] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75d792df-97d6-4e1a-bf50-631a4a868869" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.056455] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.056455] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.056563] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.056727] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.056844] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.056956] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75d792df-97d6-4e1a-bf50-631a4a868869',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.131156] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e31526a-4068-4c26-bce5-72c9c1c3964e in Status: SUCCESS [ 615.131156] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e31526a-4068-4c26-bce5-72c9c1c3964e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.131156] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e31526a-4068-4c26-bce5-72c9c1c3964e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.131434] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e31526a-4068-4c26-bce5-72c9c1c3964e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.131700] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.131876] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.131977] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.132563] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.132563] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.132563] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e31526a-4068-4c26-bce5-72c9c1c3964e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.132563] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4e31526a-4068-4c26-bce5-72c9c1c3964e',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.135801] env[67094]: INFO networking_nsxv3.common.synchronization [req-5b43d6a7-2f63-4eb3-b62a-4107cd4ac13e req-f763729b-4545-47f7-b419-d265a0f4ca91 service nova] Enqueued Resource ID: a5894e01-0dd0-4818-929b-f9f643fa6db0 with Priority: HIGHEST for action security_group_rules [ 615.136982] env[67094]: INFO networking_nsxv3.common.synchronization [req-5b43d6a7-2f63-4eb3-b62a-4107cd4ac13e req-f763729b-4545-47f7-b419-d265a0f4ca91 service nova] Enqueued Resource ID: a5894e01-0dd0-4818-929b-f9f643fa6db0 with Priority: HIGHEST for action security_group_members [ 615.136982] env[67094]: INFO networking_nsxv3.common.synchronization [req-5b43d6a7-2f63-4eb3-b62a-4107cd4ac13e req-f763729b-4545-47f7-b419-d265a0f4ca91 service nova] Enqueued Resource ID: 0ac13e6f-08b8-4e6d-b020-f9bf11a96d5f with Priority: HIGHEST for action port [ 615.139380] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5894e01-0dd0-4818-929b-f9f643fa6db0 with Priority: HIGHEST for action security_group_rules [ 615.139600] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5894e01-0dd0-4818-929b-f9f643fa6db0 with Priority: HIGHEST for action security_group_members [ 615.139760] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ac13e6f-08b8-4e6d-b020-f9bf11a96d5f with Priority: HIGHEST for action port [ 615.140778] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a5894e01-0dd0-4818-929b-f9f643fa6db0 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.140961] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a5894e01-0dd0-4818-929b-f9f643fa6db0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.141076] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a5894e01-0dd0-4818-929b-f9f643fa6db0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.141475] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a5894e01-0dd0-4818-929b-f9f643fa6db0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.141539] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a5894e01-0dd0-4818-929b-f9f643fa6db0',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.142671] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5894e01-0dd0-4818-929b-f9f643fa6db0 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.142837] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5894e01-0dd0-4818-929b-f9f643fa6db0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.142936] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5894e01-0dd0-4818-929b-f9f643fa6db0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.146811] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5894e01-0dd0-4818-929b-f9f643fa6db0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.147085] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.147252] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.147352] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.147588] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.147718] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.147854] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5894e01-0dd0-4818-929b-f9f643fa6db0',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.149095] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-0ac13e6f-08b8-4e6d-b020-f9bf11a96d5f taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.149254] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0ac13e6f-08b8-4e6d-b020-f9bf11a96d5f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.149353] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0ac13e6f-08b8-4e6d-b020-f9bf11a96d5f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.149583] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0ac13e6f-08b8-4e6d-b020-f9bf11a96d5f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.149694] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ac13e6f-08b8-4e6d-b020-f9bf11a96d5f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.236699] env[67094]: INFO networking_nsxv3.common.synchronization [None req-6725bc17-67bc-4291-a2d5-2701b09d05e0 None None] Enqueued Resource ID: 63a3b03a-8e94-4064-8f28-1730c8e15c71 with Priority: HIGHEST for action port [ 615.237824] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 63a3b03a-8e94-4064-8f28-1730c8e15c71 with Priority: HIGHEST for action port [ 615.238330] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-63a3b03a-8e94-4064-8f28-1730c8e15c71 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.238543] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-63a3b03a-8e94-4064-8f28-1730c8e15c71" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.238675] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-63a3b03a-8e94-4064-8f28-1730c8e15c71" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.239471] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-63a3b03a-8e94-4064-8f28-1730c8e15c71" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.240835] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('63a3b03a-8e94-4064-8f28-1730c8e15c71',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.331532] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9f15f829-bf18-4bc7-bdf2-32c359ef7028: rpc.has_security_group_logging(os_id): False [ 615.349812] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.349947] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.351077] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.351077] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.351077] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.351077] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.351077] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.351077] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.351077] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.351077] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.351077] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.351494] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.351494] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.351494] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.351494] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.352127] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.352127] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.352127] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.352127] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.352127] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.352127] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 is going to be updated. [ 615.354911] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f71d6693-6145-4241-b055-f03e34f73c7f in Status: SUCCESS [ 615.354911] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f71d6693-6145-4241-b055-f03e34f73c7f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.424622] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.424874] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.424994] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.425331] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.425556] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.442262] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 in Status: IN_PROGRESS for 2s [ 615.562491] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.562630] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.562730] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.563024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.563092] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.563814] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.563814] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.563814] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.563814] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.563814] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.563814] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75d792df-97d6-4e1a-bf50-631a4a868869 already deleted. [ 615.563814] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75d792df-97d6-4e1a-bf50-631a4a868869" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.576790] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock network-653 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.577017] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "network-653" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.577143] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "network-653" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.577454] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "network-653" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.578534] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.578780] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.578927] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.579240] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.579478] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.579680] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 615.579799] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 615.579927] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 615.580069] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 615.580212] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 615.580349] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 615.580514] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 615.617622] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 615.617810] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 615.618038] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 615.618305] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "network-653" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.618550] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock port-bf0eb5f2-7b3c-408d-8310-eae255144ce2 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.618999] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "port-bf0eb5f2-7b3c-408d-8310-eae255144ce2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.618999] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "port-bf0eb5f2-7b3c-408d-8310-eae255144ce2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.619249] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "port-bf0eb5f2-7b3c-408d-8310-eae255144ce2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.620875] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf0eb5f2-7b3c-408d-8310-eae255144ce2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.637406] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e31526a-4068-4c26-bce5-72c9c1c3964e taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.637582] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e31526a-4068-4c26-bce5-72c9c1c3964e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.637632] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e31526a-4068-4c26-bce5-72c9c1c3964e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.637863] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e31526a-4068-4c26-bce5-72c9c1c3964e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.638041] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.638182] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.638217] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.638454] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.638454] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.638516] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e31526a-4068-4c26-bce5-72c9c1c3964e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.638667] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e31526a-4068-4c26-bce5-72c9c1c3964e taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.638762] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e31526a-4068-4c26-bce5-72c9c1c3964e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.638824] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e31526a-4068-4c26-bce5-72c9c1c3964e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.638978] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e31526a-4068-4c26-bce5-72c9c1c3964e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.642650] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.642737] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.642737] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.642921] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.643027] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.643112] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e31526a-4068-4c26-bce5-72c9c1c3964e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.643219] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4e31526a-4068-4c26-bce5-72c9c1c3964e',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.654190] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a5894e01-0dd0-4818-929b-f9f643fa6db0',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 615.654682] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5894e01-0dd0-4818-929b-f9f643fa6db0 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.654811] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5894e01-0dd0-4818-929b-f9f643fa6db0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.655391] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0ac13e6f-08b8-4e6d-b020-f9bf11a96d5f with status ACTIVE [ 615.655683] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.655911] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.655911] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.656023] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.656092] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.657124] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.657217] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.657258] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.658395] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.658513] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.659077] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.659077] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.659077] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.659230] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.659387] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.659387] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0ac13e6f-08b8-4e6d-b020-f9bf11a96d5f is going to be updated. [ 615.694794] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.695092] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.695172] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.695360] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.695498] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.695696] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0ac13e6f-08b8-4e6d-b020-f9bf11a96d5f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.744890] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 63a3b03a-8e94-4064-8f28-1730c8e15c71 [ 615.745378] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 615.745657] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 615.745760] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 615.746016] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 615.746151] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 615.746344] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:63a3b03a-8e94-4064-8f28-1730c8e15c71 already deleted. [ 615.746401] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-63a3b03a-8e94-4064-8f28-1730c8e15c71" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.124807] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.125154] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.125320] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.125622] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.125803] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.126048] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Segment Port bf0eb5f2-7b3c-408d-8310-eae255144ce2 not found, creating... [ 616.126375] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.126582] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.126881] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.128052] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.128052] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.128052] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.128052] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.128268] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.128370] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.128544] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.128739] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Resource: SegmentPort with ID: bf0eb5f2-7b3c-408d-8310-eae255144ce2 is going to be created. [ 616.147880] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4e31526a-4068-4c26-bce5-72c9c1c3964e: rpc.has_security_group_logging(os_id): False [ 616.152072] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.152227] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.152286] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.152888] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.152888] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.153102] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "port-bf0eb5f2-7b3c-408d-8310-eae255144ce2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.156802] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a5894e01-0dd0-4818-929b-f9f643fa6db0',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.167178] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.167178] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.167178] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.167467] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.167467] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.167667] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.167804] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.167875] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.168048] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.168130] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.168330] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.168425] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.168488] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.168629] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.168707] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.168882] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.169659] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.169659] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.169659] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.169659] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.169659] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4e31526a-4068-4c26-bce5-72c9c1c3964e is going to be created. [ 616.249115] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.249676] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.249785] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.250042] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.250218] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.277674] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e31526a-4068-4c26-bce5-72c9c1c3964e in Status: IN_PROGRESS for 2s [ 616.408728] env[67094]: INFO networking_nsxv3.common.synchronization [req-9028b523-57c7-4ff4-9307-3e13ebc3e1e6 req-60aeeda9-9a96-4f3d-808e-c27f904de817 tempest-ImagesTestJSON-2097058733 tempest-ImagesTestJSON-2097058733-project-member] Enqueued Resource ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa with Priority: HIGHEST for action security_group_members [ 616.409465] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa with Priority: HIGHEST for action security_group_members [ 616.409779] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-84918628-8f8e-4d25-9c0f-17cccb58ebfa taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.409922] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.409994] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.410312] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.410512] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.410620] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.410673] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.410902] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.410990] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.411107] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('84918628-8f8e-4d25-9c0f-17cccb58ebfa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.660398] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.660570] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.660691] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.661089] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.661297] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.661420] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5894e01-0dd0-4818-929b-f9f643fa6db0 is going to be created. [ 616.694672] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.695583] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.695754] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.696167] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.696468] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.711867] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5894e01-0dd0-4818-929b-f9f643fa6db0 in Status: UNINITIALIZED for 2s [ 616.913892] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.913994] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.914192] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.914282] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.914378] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.914650] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.914771] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.914821] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.914975] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.915070] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.915159] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa already deleted. [ 616.915241] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.935804] env[67094]: INFO networking_nsxv3.common.synchronization [req-1e8ea085-4686-461e-9093-3dfa7a779128 req-cc5f7587-6a5f-41f7-b60b-5e86dc6b9def service nova] Enqueued Resource ID: 75d792df-97d6-4e1a-bf50-631a4a868869 with Priority: HIGHEST for action security_group_rules [ 616.936042] env[67094]: INFO networking_nsxv3.common.synchronization [req-1e8ea085-4686-461e-9093-3dfa7a779128 req-cc5f7587-6a5f-41f7-b60b-5e86dc6b9def service nova] Enqueued Resource ID: 75d792df-97d6-4e1a-bf50-631a4a868869 with Priority: HIGHEST for action security_group_members [ 616.936217] env[67094]: INFO networking_nsxv3.common.synchronization [req-1e8ea085-4686-461e-9093-3dfa7a779128 req-cc5f7587-6a5f-41f7-b60b-5e86dc6b9def service nova] Enqueued Resource ID: bf0eb5f2-7b3c-408d-8310-eae255144ce2 with Priority: HIGHEST for action port [ 616.937263] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75d792df-97d6-4e1a-bf50-631a4a868869 with Priority: HIGHEST for action security_group_rules [ 616.937505] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75d792df-97d6-4e1a-bf50-631a4a868869 with Priority: HIGHEST for action security_group_members [ 616.937676] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bf0eb5f2-7b3c-408d-8310-eae255144ce2 with Priority: HIGHEST for action port [ 616.938123] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-75d792df-97d6-4e1a-bf50-631a4a868869 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.938355] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-75d792df-97d6-4e1a-bf50-631a4a868869" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.938564] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-75d792df-97d6-4e1a-bf50-631a4a868869" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.938885] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-75d792df-97d6-4e1a-bf50-631a4a868869" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.938960] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('75d792df-97d6-4e1a-bf50-631a4a868869',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.939949] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-75d792df-97d6-4e1a-bf50-631a4a868869 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.941062] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75d792df-97d6-4e1a-bf50-631a4a868869" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.941816] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75d792df-97d6-4e1a-bf50-631a4a868869" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.942269] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75d792df-97d6-4e1a-bf50-631a4a868869" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.942269] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.942269] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.942449] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.942449] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.942616] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.942666] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75d792df-97d6-4e1a-bf50-631a4a868869',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.943579] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-bf0eb5f2-7b3c-408d-8310-eae255144ce2 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.943855] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bf0eb5f2-7b3c-408d-8310-eae255144ce2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.943855] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bf0eb5f2-7b3c-408d-8310-eae255144ce2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.943979] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bf0eb5f2-7b3c-408d-8310-eae255144ce2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.944050] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bf0eb5f2-7b3c-408d-8310-eae255144ce2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 616.958780] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock network-842 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.958978] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "network-842" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.959166] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "network-842" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.959574] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "network-842" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.960396] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.960666] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.960867] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.961222] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.961469] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.961745] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 616.961923] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 616.962131] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 616.962271] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 616.962468] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 616.962643] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 616.962789] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 616.985400] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 616.985598] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 616.985715] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 616.985903] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "network-842" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 616.986281] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock port-03c9d4ca-b127-44ce-8a61-ac645ef0d42b taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 616.986456] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "port-03c9d4ca-b127-44ce-8a61-ac645ef0d42b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 616.986571] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "port-03c9d4ca-b127-44ce-8a61-ac645ef0d42b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 616.986967] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "port-03c9d4ca-b127-44ce-8a61-ac645ef0d42b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 616.987151] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03c9d4ca-b127-44ce-8a61-ac645ef0d42b',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.445636] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-75d792df-97d6-4e1a-bf50-631a4a868869 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.445636] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75d792df-97d6-4e1a-bf50-631a4a868869" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.452029] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('75d792df-97d6-4e1a-bf50-631a4a868869',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.452029] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bf0eb5f2-7b3c-408d-8310-eae255144ce2 with status ACTIVE [ 617.452029] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.452029] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.452029] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.452029] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.452029] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.452029] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.452029] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.452029] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.452029] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.452029] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.452029] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.452029] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.452029] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.452029] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.452636] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.452636] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bf0eb5f2-7b3c-408d-8310-eae255144ce2 is going to be updated. [ 617.457282] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 in Status: SUCCESS [ 617.457492] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.457657] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.457886] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.457984] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9f15f829-bf18-4bc7-bdf2-32c359ef7028',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.474662] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.474759] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.474839] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.475078] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.475240] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.475380] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bf0eb5f2-7b3c-408d-8310-eae255144ce2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.489553] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.489903] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.489903] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.490164] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.490306] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.490458] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Segment Port 03c9d4ca-b127-44ce-8a61-ac645ef0d42b not found, creating... [ 617.490715] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.490880] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.490996] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.491235] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.491411] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.491790] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.492088] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.492206] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.492444] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.492578] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.492725] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Resource: SegmentPort with ID: 03c9d4ca-b127-44ce-8a61-ac645ef0d42b is going to be created. [ 617.514342] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.514744] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.514980] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.515385] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.515714] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.516036] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "port-03c9d4ca-b127-44ce-8a61-ac645ef0d42b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.955814] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('75d792df-97d6-4e1a-bf50-631a4a868869',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 617.961187] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f15f829-bf18-4bc7-bdf2-32c359ef7028 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.961345] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.961422] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.961634] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.961805] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 617.961901] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 617.962276] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 617.962276] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 617.962276] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.962390] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 617.962390] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9f15f829-bf18-4bc7-bdf2-32c359ef7028',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.253692] env[67094]: INFO networking_nsxv3.common.synchronization [req-9028b523-57c7-4ff4-9307-3e13ebc3e1e6 req-c42fcfdd-0e63-4b14-ad52-c89644cb2021 service nova] Enqueued Resource ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa with Priority: HIGHEST for action security_group_rules [ 618.253916] env[67094]: INFO networking_nsxv3.common.synchronization [req-9028b523-57c7-4ff4-9307-3e13ebc3e1e6 req-c42fcfdd-0e63-4b14-ad52-c89644cb2021 service nova] Enqueued Resource ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa with Priority: HIGHEST for action security_group_members [ 618.254108] env[67094]: INFO networking_nsxv3.common.synchronization [req-9028b523-57c7-4ff4-9307-3e13ebc3e1e6 req-c42fcfdd-0e63-4b14-ad52-c89644cb2021 service nova] Enqueued Resource ID: 03c9d4ca-b127-44ce-8a61-ac645ef0d42b with Priority: HIGHEST for action port [ 618.254787] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa with Priority: HIGHEST for action security_group_rules [ 618.254897] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa with Priority: HIGHEST for action security_group_members [ 618.255063] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 03c9d4ca-b127-44ce-8a61-ac645ef0d42b with Priority: HIGHEST for action port [ 618.255914] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-84918628-8f8e-4d25-9c0f-17cccb58ebfa taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.255914] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.255914] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.255914] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.256089] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('84918628-8f8e-4d25-9c0f-17cccb58ebfa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.257294] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-84918628-8f8e-4d25-9c0f-17cccb58ebfa taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.258046] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.258046] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.258046] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.258046] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.258046] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.258046] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.258546] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.258546] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.258546] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('84918628-8f8e-4d25-9c0f-17cccb58ebfa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.259586] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-03c9d4ca-b127-44ce-8a61-ac645ef0d42b taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.260364] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-03c9d4ca-b127-44ce-8a61-ac645ef0d42b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.260364] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-03c9d4ca-b127-44ce-8a61-ac645ef0d42b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.261141] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-03c9d4ca-b127-44ce-8a61-ac645ef0d42b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.261141] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('03c9d4ca-b127-44ce-8a61-ac645ef0d42b',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.309128] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4e31526a-4068-4c26-bce5-72c9c1c3964e in Status: SUCCESS [ 618.309461] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4e31526a-4068-4c26-bce5-72c9c1c3964e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.458195] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.458594] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.458594] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.458764] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.458764] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.458823] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75d792df-97d6-4e1a-bf50-631a4a868869 is going to be created. [ 618.468617] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f15f829-bf18-4bc7-bdf2-32c359ef7028 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.468984] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.469239] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.469711] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.470546] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.470797] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.470861] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.471219] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.471371] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.471498] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.471726] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f15f829-bf18-4bc7-bdf2-32c359ef7028 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.471876] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.471966] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.472175] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.472359] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.472500] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.472572] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.472760] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.472870] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.472957] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.473157] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9f15f829-bf18-4bc7-bdf2-32c359ef7028',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.486951] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.487121] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.487192] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.487438] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.487605] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.499540] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75d792df-97d6-4e1a-bf50-631a4a868869 in Status: UNINITIALIZED for 2s [ 618.725254] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5894e01-0dd0-4818-929b-f9f643fa6db0 in Status: SUCCESS [ 618.725589] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5894e01-0dd0-4818-929b-f9f643fa6db0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.725758] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5894e01-0dd0-4818-929b-f9f643fa6db0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.725970] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5894e01-0dd0-4818-929b-f9f643fa6db0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.726317] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.726317] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.726534] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.726570] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.726662] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.726784] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5894e01-0dd0-4818-929b-f9f643fa6db0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.726844] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a5894e01-0dd0-4818-929b-f9f643fa6db0',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.764261] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-84918628-8f8e-4d25-9c0f-17cccb58ebfa taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.767616] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.767616] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('84918628-8f8e-4d25-9c0f-17cccb58ebfa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 618.767616] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 03c9d4ca-b127-44ce-8a61-ac645ef0d42b with status ACTIVE [ 618.767616] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.767616] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.767616] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.767616] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.767616] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.767616] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.767616] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.770891] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.771204] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.771306] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.771552] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.771692] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.771779] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.772016] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.772121] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.772428] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 03c9d4ca-b127-44ce-8a61-ac645ef0d42b is going to be updated. [ 618.809090] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 618.809090] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 618.809090] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 618.809090] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 618.809090] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.809090] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-03c9d4ca-b127-44ce-8a61-ac645ef0d42b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 618.978918] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9f15f829-bf18-4bc7-bdf2-32c359ef7028: rpc.has_security_group_logging(os_id): False [ 619.002065] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.002300] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.002300] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.002487] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.002580] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.002772] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.003583] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.003583] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.003583] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.003583] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.003583] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.003583] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.003809] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.003862] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.003909] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.004609] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.004609] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.004854] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.004914] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.004982] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.006300] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 is going to be updated. [ 619.076934] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.077104] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.077181] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.077400] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.077547] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.096236] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 in Status: IN_PROGRESS for 2s [ 619.231292] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5894e01-0dd0-4818-929b-f9f643fa6db0 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.231292] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5894e01-0dd0-4818-929b-f9f643fa6db0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.231292] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5894e01-0dd0-4818-929b-f9f643fa6db0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.231292] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5894e01-0dd0-4818-929b-f9f643fa6db0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.231496] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.232286] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.232286] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.232286] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.232286] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.232286] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5894e01-0dd0-4818-929b-f9f643fa6db0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.232557] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5894e01-0dd0-4818-929b-f9f643fa6db0 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.232557] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5894e01-0dd0-4818-929b-f9f643fa6db0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.232707] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5894e01-0dd0-4818-929b-f9f643fa6db0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.232917] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5894e01-0dd0-4818-929b-f9f643fa6db0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.234461] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.235429] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.235429] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.235429] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.235429] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.235429] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5894e01-0dd0-4818-929b-f9f643fa6db0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.235429] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a5894e01-0dd0-4818-929b-f9f643fa6db0',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.274543] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('84918628-8f8e-4d25-9c0f-17cccb58ebfa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.712424] env[67094]: INFO networking_nsxv3.common.synchronization [req-91f72d07-516a-4fe0-9821-03516b987d66 req-addb5b81-aa65-4d4a-a2f3-023eff100ab6 tempest-DeleteServersAdminTestJSON-712223354 tempest-DeleteServersAdminTestJSON-712223354-project-admin] Enqueued Resource ID: 34103f55-eb7e-4602-9672-09596df7eaa4 with Priority: HIGHEST for action security_group_members [ 619.713748] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34103f55-eb7e-4602-9672-09596df7eaa4 with Priority: HIGHEST for action security_group_members [ 619.714172] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-34103f55-eb7e-4602-9672-09596df7eaa4 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.714264] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34103f55-eb7e-4602-9672-09596df7eaa4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.714359] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34103f55-eb7e-4602-9672-09596df7eaa4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.714556] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34103f55-eb7e-4602-9672-09596df7eaa4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.714556] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.714891] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.714891] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.715113] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.715343] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.715343] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34103f55-eb7e-4602-9672-09596df7eaa4',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 619.741018] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a5894e01-0dd0-4818-929b-f9f643fa6db0: rpc.has_security_group_logging(os_id): False [ 619.763431] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.763600] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.764818] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.764818] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.764818] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.764818] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.764818] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.764818] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.765147] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.765147] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.765355] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.765457] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.765515] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.765682] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.765752] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.765940] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.766069] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.766194] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.766336] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.766501] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.766658] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a5894e01-0dd0-4818-929b-f9f643fa6db0 is going to be created. [ 619.778551] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.778872] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.778972] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.781123] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.781123] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.781123] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa is going to be created. [ 619.826149] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.826387] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.826433] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.826664] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.826941] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.838223] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa in Status: UNINITIALIZED for 2s [ 619.857651] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 619.857651] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 619.857651] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 619.857887] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 619.857979] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 619.877402] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a5894e01-0dd0-4818-929b-f9f643fa6db0 in Status: IN_PROGRESS for 2s [ 620.218219] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.218442] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.218442] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.219212] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.219212] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.219212] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.219212] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.219212] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.219480] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.219480] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.219480] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34103f55-eb7e-4602-9672-09596df7eaa4 is going to be updated. [ 620.272030] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.272030] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.272030] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.272658] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.273490] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.284779] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34103f55-eb7e-4602-9672-09596df7eaa4 in Status: IN_PROGRESS for 2s [ 620.510852] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75d792df-97d6-4e1a-bf50-631a4a868869 in Status: SUCCESS [ 620.511112] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75d792df-97d6-4e1a-bf50-631a4a868869" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.511311] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75d792df-97d6-4e1a-bf50-631a4a868869" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.511514] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75d792df-97d6-4e1a-bf50-631a4a868869" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.511719] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 620.511876] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 620.511940] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 620.512128] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 620.512263] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.512361] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75d792df-97d6-4e1a-bf50-631a4a868869" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 620.512456] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('75d792df-97d6-4e1a-bf50-631a4a868869',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.017325] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-75d792df-97d6-4e1a-bf50-631a4a868869 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.017616] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75d792df-97d6-4e1a-bf50-631a4a868869" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.017616] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75d792df-97d6-4e1a-bf50-631a4a868869" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.017899] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75d792df-97d6-4e1a-bf50-631a4a868869" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.018092] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.018204] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.018299] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.018702] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.018702] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.018702] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75d792df-97d6-4e1a-bf50-631a4a868869" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.021051] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-75d792df-97d6-4e1a-bf50-631a4a868869 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.021351] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75d792df-97d6-4e1a-bf50-631a4a868869" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.021351] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75d792df-97d6-4e1a-bf50-631a4a868869" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.021784] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75d792df-97d6-4e1a-bf50-631a4a868869" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.021784] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.021784] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.022141] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.022141] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.022141] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.022226] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75d792df-97d6-4e1a-bf50-631a4a868869" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.022258] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('75d792df-97d6-4e1a-bf50-631a4a868869',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.120859] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 in Status: SUCCESS [ 621.120969] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.341430] env[67094]: INFO networking_nsxv3.common.synchronization [None req-35e200ed-ae1f-4005-a32b-799813c5aaaf tempest-ServersWithSpecificFlavorTestJSON-602104183 tempest-ServersWithSpecificFlavorTestJSON-602104183-project-member] Enqueued Resource ID: 60943622-73b5-4dda-ad21-63bf08db617e with Priority: HIGHEST for action security_group_rules [ 621.342212] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60943622-73b5-4dda-ad21-63bf08db617e with Priority: HIGHEST for action security_group_rules [ 621.342525] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-60943622-73b5-4dda-ad21-63bf08db617e taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.342825] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-60943622-73b5-4dda-ad21-63bf08db617e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.342825] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-60943622-73b5-4dda-ad21-63bf08db617e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.343548] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-60943622-73b5-4dda-ad21-63bf08db617e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.343548] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('60943622-73b5-4dda-ad21-63bf08db617e',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.463356] env[67094]: INFO networking_nsxv3.common.synchronization [None req-0a06b999-824d-4411-987e-53121369c5c6 tempest-ServersWithSpecificFlavorTestJSON-602104183 tempest-ServersWithSpecificFlavorTestJSON-602104183-project-member] Enqueued Resource ID: 60943622-73b5-4dda-ad21-63bf08db617e with Priority: HIGHEST for action security_group_rules [ 621.463356] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60943622-73b5-4dda-ad21-63bf08db617e with Priority: HIGHEST for action security_group_rules [ 621.463356] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-60943622-73b5-4dda-ad21-63bf08db617e taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.463356] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-60943622-73b5-4dda-ad21-63bf08db617e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.525299] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 75d792df-97d6-4e1a-bf50-631a4a868869: rpc.has_security_group_logging(os_id): False [ 621.546724] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.547029] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.547197] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.547385] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.547520] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.547898] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.548533] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.548533] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.548533] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.548533] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.548766] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.548766] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.548868] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.549236] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.549322] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.549506] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.549595] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.549678] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.549936] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.550039] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.550142] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 75d792df-97d6-4e1a-bf50-631a4a868869 is going to be created. [ 621.612186] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.612515] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.612515] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.612729] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.612933] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.626582] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 75d792df-97d6-4e1a-bf50-631a4a868869 in Status: IN_PROGRESS for 2s [ 621.873525] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa in Status: SUCCESS [ 621.873525] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.873805] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.873897] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.874143] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.874357] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.874357] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.874529] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.875542] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.875542] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.875542] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('84918628-8f8e-4d25-9c0f-17cccb58ebfa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.881118] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 621.881312] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 621.881312] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.881659] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.881751] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.881846] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 60943622-73b5-4dda-ad21-63bf08db617e already deleted. [ 621.881927] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-60943622-73b5-4dda-ad21-63bf08db617e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 621.882090] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-60943622-73b5-4dda-ad21-63bf08db617e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 621.882856] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-60943622-73b5-4dda-ad21-63bf08db617e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 621.882856] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('60943622-73b5-4dda-ad21-63bf08db617e',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 621.894219] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a5894e01-0dd0-4818-929b-f9f643fa6db0 in Status: SUCCESS [ 621.894219] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a5894e01-0dd0-4818-929b-f9f643fa6db0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.314614] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34103f55-eb7e-4602-9672-09596df7eaa4 in Status: SUCCESS [ 622.315357] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34103f55-eb7e-4602-9672-09596df7eaa4 deletion is rescheduled due to dependency. [ 622.315592] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34103f55-eb7e-4602-9672-09596df7eaa4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.378331] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-84918628-8f8e-4d25-9c0f-17cccb58ebfa taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.378533] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.378573] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.378821] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.378985] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.379113] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.379214] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.379427] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.379649] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.379649] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.379787] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-84918628-8f8e-4d25-9c0f-17cccb58ebfa taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.379906] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.379990] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.380187] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.380338] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.380428] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.380489] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.380629] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.380916] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.381139] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.381366] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('84918628-8f8e-4d25-9c0f-17cccb58ebfa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 622.408289] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.408433] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.408433] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.408692] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.408792] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.408893] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 60943622-73b5-4dda-ad21-63bf08db617e already deleted. [ 622.409031] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-60943622-73b5-4dda-ad21-63bf08db617e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.883992] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 84918628-8f8e-4d25-9c0f-17cccb58ebfa: rpc.has_security_group_logging(os_id): False [ 622.904339] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.904554] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.904632] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.904883] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.905113] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.905268] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.905355] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.905452] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.905629] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.905729] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.905931] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.906079] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.906167] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.906339] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.906436] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.907985] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.907985] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.907985] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.907985] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.907985] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.908241] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa is going to be created. [ 622.972114] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 622.972322] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 622.973229] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 622.973229] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 622.973229] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 622.983148] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa in Status: IN_PROGRESS for 2s [ 623.646625] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 75d792df-97d6-4e1a-bf50-631a4a868869 in Status: SUCCESS [ 623.648440] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-75d792df-97d6-4e1a-bf50-631a4a868869" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.305398] env[67094]: INFO networking_nsxv3.common.synchronization [req-d8959eb1-6240-4d4a-b75b-2ff996455f73 req-995fbfa8-405d-4376-872f-d099946c4f46 tempest-ServersTestJSON-1070791530 tempest-ServersTestJSON-1070791530-project-member] Enqueued Resource ID: c0881101-1be1-4dbf-ac18-2d54a689202c with Priority: HIGHEST for action security_group_members [ 624.305947] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0881101-1be1-4dbf-ac18-2d54a689202c with Priority: HIGHEST for action security_group_members [ 624.308253] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0881101-1be1-4dbf-ac18-2d54a689202c taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.308253] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.308253] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.308253] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.308253] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.308253] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.308253] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.308253] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.308253] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.308253] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 624.811847] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.812196] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.812283] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.812567] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.812679] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.812915] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.813068] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.813133] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.813278] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.813347] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.813439] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0881101-1be1-4dbf-ac18-2d54a689202c already deleted. [ 624.813517] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.871726] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock network-91 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.871726] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "network-91" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.872080] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "network-91" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.872418] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "network-91" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.873559] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.873559] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.873559] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.873948] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.874114] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.874376] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 624.874551] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 624.874657] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 624.875577] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 624.875577] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 624.875577] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 624.875577] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 624.912881] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 624.913137] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Cache value generated in 0.038 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 624.913349] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 624.913619] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "network-91" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 624.914120] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock port-e0245da7-e08a-4f23-8510-1d8f8a8bc0c6 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 624.914385] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "port-e0245da7-e08a-4f23-8510-1d8f8a8bc0c6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 624.914925] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "port-e0245da7-e08a-4f23-8510-1d8f8a8bc0c6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 624.915515] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "port-e0245da7-e08a-4f23-8510-1d8f8a8bc0c6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 624.916268] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0245da7-e08a-4f23-8510-1d8f8a8bc0c6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 625.015620] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa in Status: SUCCESS [ 625.015620] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.419646] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.419868] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.419994] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.420394] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.420576] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.420760] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Segment Port e0245da7-e08a-4f23-8510-1d8f8a8bc0c6 not found, creating... [ 625.421108] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.421291] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.421407] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.421645] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.421817] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.422223] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.422370] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.422560] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.422835] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.423057] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.423259] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Resource: SegmentPort with ID: e0245da7-e08a-4f23-8510-1d8f8a8bc0c6 is going to be created. [ 625.447296] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 625.447520] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 625.447645] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 625.448074] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 625.448328] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 625.448557] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "port-e0245da7-e08a-4f23-8510-1d8f8a8bc0c6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.014728] env[67094]: INFO networking_nsxv3.common.synchronization [req-a6c49de6-c735-431e-a3c2-e8e4c1cd274a req-49acfc11-c056-470a-8ea4-0c302af8aace tempest-ServerExternalEventsTest-1243958627 tempest-ServerExternalEventsTest-1243958627-project-member] Enqueued Resource ID: 6427f088-550f-4c69-a5dd-5f9c7d4aadcf with Priority: HIGHEST for action security_group_members [ 626.015474] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6427f088-550f-4c69-a5dd-5f9c7d4aadcf with Priority: HIGHEST for action security_group_members [ 626.015922] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-6427f088-550f-4c69-a5dd-5f9c7d4aadcf taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.016332] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6427f088-550f-4c69-a5dd-5f9c7d4aadcf" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.016453] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6427f088-550f-4c69-a5dd-5f9c7d4aadcf" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.016764] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6427f088-550f-4c69-a5dd-5f9c7d4aadcf" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.017020] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.017184] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.017804] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.018099] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.018247] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.018398] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6427f088-550f-4c69-a5dd-5f9c7d4aadcf',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.124352] env[67094]: INFO networking_nsxv3.common.synchronization [req-d8959eb1-6240-4d4a-b75b-2ff996455f73 req-fa078e79-62b0-4c53-9ce8-70a5887ffae6 service nova] Enqueued Resource ID: c0881101-1be1-4dbf-ac18-2d54a689202c with Priority: HIGHEST for action security_group_rules [ 626.124352] env[67094]: INFO networking_nsxv3.common.synchronization [req-d8959eb1-6240-4d4a-b75b-2ff996455f73 req-fa078e79-62b0-4c53-9ce8-70a5887ffae6 service nova] Enqueued Resource ID: c0881101-1be1-4dbf-ac18-2d54a689202c with Priority: HIGHEST for action security_group_members [ 626.124352] env[67094]: INFO networking_nsxv3.common.synchronization [req-d8959eb1-6240-4d4a-b75b-2ff996455f73 req-fa078e79-62b0-4c53-9ce8-70a5887ffae6 service nova] Enqueued Resource ID: e0245da7-e08a-4f23-8510-1d8f8a8bc0c6 with Priority: HIGHEST for action port [ 626.124352] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0881101-1be1-4dbf-ac18-2d54a689202c with Priority: HIGHEST for action security_group_rules [ 626.124352] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0881101-1be1-4dbf-ac18-2d54a689202c with Priority: HIGHEST for action security_group_members [ 626.124352] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e0245da7-e08a-4f23-8510-1d8f8a8bc0c6 with Priority: HIGHEST for action port [ 626.124793] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0881101-1be1-4dbf-ac18-2d54a689202c taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.125068] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.125229] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.125574] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.125955] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.126896] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0881101-1be1-4dbf-ac18-2d54a689202c taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.127255] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.127420] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.127683] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.127931] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.128180] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.128330] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.128560] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.129019] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.129019] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.134032] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-e0245da7-e08a-4f23-8510-1d8f8a8bc0c6 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.134032] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e0245da7-e08a-4f23-8510-1d8f8a8bc0c6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.134032] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e0245da7-e08a-4f23-8510-1d8f8a8bc0c6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.134032] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e0245da7-e08a-4f23-8510-1d8f8a8bc0c6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.134032] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e0245da7-e08a-4f23-8510-1d8f8a8bc0c6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.524629] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.524629] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.524629] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.524629] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.524629] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.524629] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.524629] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.524629] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.524629] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.524629] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.524629] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6427f088-550f-4c69-a5dd-5f9c7d4aadcf is going to be updated. [ 626.556961] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.557432] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.557432] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.557787] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.557787] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.573923] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6427f088-550f-4c69-a5dd-5f9c7d4aadcf in Status: IN_PROGRESS for 2s [ 626.637959] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0881101-1be1-4dbf-ac18-2d54a689202c taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.637959] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.637959] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 626.637959] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e0245da7-e08a-4f23-8510-1d8f8a8bc0c6 with status ACTIVE [ 626.637959] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.637959] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.637959] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.637959] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.637959] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.637959] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.637959] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.637959] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.640492] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.640492] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.640492] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.640492] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.640492] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.640492] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.640492] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.640492] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e0245da7-e08a-4f23-8510-1d8f8a8bc0c6 is going to be updated. [ 626.664283] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 626.664471] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 626.664471] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 626.666818] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 626.666818] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 626.666818] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e0245da7-e08a-4f23-8510-1d8f8a8bc0c6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.145397] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 627.648641] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.648804] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.648922] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.649191] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.649191] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.649306] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0881101-1be1-4dbf-ac18-2d54a689202c is going to be created. [ 627.678303] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 627.678470] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 627.678596] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 627.678872] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 627.679140] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 627.694139] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0881101-1be1-4dbf-ac18-2d54a689202c in Status: UNINITIALIZED for 2s [ 628.583660] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6427f088-550f-4c69-a5dd-5f9c7d4aadcf in Status: SUCCESS [ 628.584685] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6427f088-550f-4c69-a5dd-5f9c7d4aadcf deletion is rescheduled due to dependency. [ 628.584685] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6427f088-550f-4c69-a5dd-5f9c7d4aadcf" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.631263] env[67094]: INFO networking_nsxv3.common.synchronization [req-adc7ae05-bf7a-4dda-8ba2-9307377130ed req-9da75be9-e66b-4c36-8c13-cae72ee44820 tempest-FloatingIPsAssociationNegativeTestJSON-944970584 tempest-FloatingIPsAssociationNegativeTestJSON-944970584-project-member] Enqueued Resource ID: 62f0dd40-a793-48dd-b62a-abaa0eeebd45 with Priority: HIGHEST for action security_group_members [ 628.632021] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62f0dd40-a793-48dd-b62a-abaa0eeebd45 with Priority: HIGHEST for action security_group_members [ 628.632411] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-62f0dd40-a793-48dd-b62a-abaa0eeebd45 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.632572] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62f0dd40-a793-48dd-b62a-abaa0eeebd45" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.632639] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62f0dd40-a793-48dd-b62a-abaa0eeebd45" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.632946] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62f0dd40-a793-48dd-b62a-abaa0eeebd45" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.633257] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 628.633257] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 628.633402] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 628.633453] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 628.633550] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 628.633648] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('62f0dd40-a793-48dd-b62a-abaa0eeebd45',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.137244] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.137244] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.137244] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.137400] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.137497] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.137694] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.137786] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.137900] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.138027] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.138106] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.138187] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 62f0dd40-a793-48dd-b62a-abaa0eeebd45 already deleted. [ 629.138263] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62f0dd40-a793-48dd-b62a-abaa0eeebd45" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.142708] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock network-919 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.142907] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "network-919" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.143038] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "network-919" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.143353] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "network-919" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.143616] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.143772] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.143887] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.145115] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.147424] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.147424] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 629.147424] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 629.147424] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 629.147424] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 629.147424] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 629.147424] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 629.147424] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 629.172351] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 629.172827] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 629.172827] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 629.173029] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "network-919" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.173424] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock port-d6402682-4b1e-434e-bf15-99851669863f taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.173656] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "port-d6402682-4b1e-434e-bf15-99851669863f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.173818] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "port-d6402682-4b1e-434e-bf15-99851669863f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.174569] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "port-d6402682-4b1e-434e-bf15-99851669863f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.174690] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6402682-4b1e-434e-bf15-99851669863f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.681321] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.681321] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.681321] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.681908] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.681908] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.682148] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Segment Port d6402682-4b1e-434e-bf15-99851669863f not found, creating... [ 629.682379] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.682625] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.682804] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.683139] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.683373] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.683761] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.683972] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.684164] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.684497] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.684699] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.685016] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Resource: SegmentPort with ID: d6402682-4b1e-434e-bf15-99851669863f is going to be created. [ 629.705982] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0881101-1be1-4dbf-ac18-2d54a689202c in Status: SUCCESS [ 629.706272] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.706546] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.706957] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.707249] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.707455] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.707562] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.707941] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.708198] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.708364] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.708522] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 629.711199] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 629.712169] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 629.712169] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 629.712169] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 629.712469] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 629.712763] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "port-d6402682-4b1e-434e-bf15-99851669863f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.216558] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0881101-1be1-4dbf-ac18-2d54a689202c taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.216558] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.216558] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.216830] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.216955] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.217074] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.217134] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.218103] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.218103] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.218103] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.218103] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0881101-1be1-4dbf-ac18-2d54a689202c taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.218103] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.218103] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.218103] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.218103] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.218471] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.218471] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.218471] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.218471] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.218600] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.218600] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.427877] env[67094]: INFO networking_nsxv3.common.synchronization [req-adc7ae05-bf7a-4dda-8ba2-9307377130ed req-7e51cb87-be28-4a91-8217-62b136dd68ca service nova] Enqueued Resource ID: 62f0dd40-a793-48dd-b62a-abaa0eeebd45 with Priority: HIGHEST for action security_group_rules [ 630.428055] env[67094]: INFO networking_nsxv3.common.synchronization [req-adc7ae05-bf7a-4dda-8ba2-9307377130ed req-7e51cb87-be28-4a91-8217-62b136dd68ca service nova] Enqueued Resource ID: 62f0dd40-a793-48dd-b62a-abaa0eeebd45 with Priority: HIGHEST for action security_group_members [ 630.428187] env[67094]: INFO networking_nsxv3.common.synchronization [req-adc7ae05-bf7a-4dda-8ba2-9307377130ed req-7e51cb87-be28-4a91-8217-62b136dd68ca service nova] Enqueued Resource ID: d6402682-4b1e-434e-bf15-99851669863f with Priority: HIGHEST for action port [ 630.430012] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62f0dd40-a793-48dd-b62a-abaa0eeebd45 with Priority: HIGHEST for action security_group_rules [ 630.430012] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62f0dd40-a793-48dd-b62a-abaa0eeebd45 with Priority: HIGHEST for action security_group_members [ 630.430012] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6402682-4b1e-434e-bf15-99851669863f with Priority: HIGHEST for action port [ 630.430012] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-62f0dd40-a793-48dd-b62a-abaa0eeebd45 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.430012] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-62f0dd40-a793-48dd-b62a-abaa0eeebd45" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.430012] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-62f0dd40-a793-48dd-b62a-abaa0eeebd45" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.430576] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-62f0dd40-a793-48dd-b62a-abaa0eeebd45" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.430576] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('62f0dd40-a793-48dd-b62a-abaa0eeebd45',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.431070] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-62f0dd40-a793-48dd-b62a-abaa0eeebd45 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.431195] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62f0dd40-a793-48dd-b62a-abaa0eeebd45" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.431276] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62f0dd40-a793-48dd-b62a-abaa0eeebd45" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.431734] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62f0dd40-a793-48dd-b62a-abaa0eeebd45" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.431939] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.432027] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.432105] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.432262] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.432367] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.434015] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('62f0dd40-a793-48dd-b62a-abaa0eeebd45',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.434015] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-d6402682-4b1e-434e-bf15-99851669863f taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.434015] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d6402682-4b1e-434e-bf15-99851669863f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.434015] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d6402682-4b1e-434e-bf15-99851669863f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.434015] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d6402682-4b1e-434e-bf15-99851669863f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.434015] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6402682-4b1e-434e-bf15-99851669863f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.722379] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c0881101-1be1-4dbf-ac18-2d54a689202c: rpc.has_security_group_logging(os_id): False [ 630.741608] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.741764] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.741851] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.742056] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.742147] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.742339] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.742434] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.742488] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.742644] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.742711] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.742891] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.742990] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.743057] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.743189] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.743353] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.743561] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.743720] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.743776] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.743922] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.744063] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.744149] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0881101-1be1-4dbf-ac18-2d54a689202c is going to be created. [ 630.805495] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.805670] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.805742] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.806685] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.806685] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.817721] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0881101-1be1-4dbf-ac18-2d54a689202c in Status: IN_PROGRESS for 2s [ 630.871857] env[67094]: INFO networking_nsxv3.common.synchronization [None req-64d60941-6374-4e26-994a-778daaedb250 None None] Enqueued Resource ID: f6d9d1fc-a0e1-44d9-bd38-fb5d9fca062d with Priority: HIGHEST for action port [ 630.872328] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f6d9d1fc-a0e1-44d9-bd38-fb5d9fca062d with Priority: HIGHEST for action port [ 630.873026] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-f6d9d1fc-a0e1-44d9-bd38-fb5d9fca062d taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.873026] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f6d9d1fc-a0e1-44d9-bd38-fb5d9fca062d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.873026] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f6d9d1fc-a0e1-44d9-bd38-fb5d9fca062d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.873353] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f6d9d1fc-a0e1-44d9-bd38-fb5d9fca062d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.873454] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f6d9d1fc-a0e1-44d9-bd38-fb5d9fca062d',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.935529] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-62f0dd40-a793-48dd-b62a-abaa0eeebd45 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.935656] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62f0dd40-a793-48dd-b62a-abaa0eeebd45" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.935772] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d6402682-4b1e-434e-bf15-99851669863f with status ACTIVE [ 630.935941] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.936114] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.936114] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.936326] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.936632] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.936632] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.936757] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.936757] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.936889] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.936970] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.937172] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.937265] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.937327] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.937467] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.937540] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.937623] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d6402682-4b1e-434e-bf15-99851669863f is going to be updated. [ 630.939315] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('62f0dd40-a793-48dd-b62a-abaa0eeebd45',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 630.962995] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 630.963108] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 630.963146] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 630.963352] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 630.963492] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 630.963651] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d6402682-4b1e-434e-bf15-99851669863f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.377045] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f6d9d1fc-a0e1-44d9-bd38-fb5d9fca062d [ 631.377434] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.377590] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.377659] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.377903] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.377994] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.378110] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f6d9d1fc-a0e1-44d9-bd38-fb5d9fca062d already deleted. [ 631.378191] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f6d9d1fc-a0e1-44d9-bd38-fb5d9fca062d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.398874] env[67094]: INFO networking_nsxv3.common.synchronization [req-b8374b7c-4ad0-4c33-a57b-752b41fa58a0 req-ea8b1e3d-d857-46f9-8f6f-c37ded9929a3 tempest-TenantUsagesTestJSON-1786793036 tempest-TenantUsagesTestJSON-1786793036-project-member] Enqueued Resource ID: cb367675-42aa-4b50-8812-8a73fdef747d with Priority: HIGHEST for action security_group_members [ 631.399484] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cb367675-42aa-4b50-8812-8a73fdef747d with Priority: HIGHEST for action security_group_members [ 631.399801] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-cb367675-42aa-4b50-8812-8a73fdef747d taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.399933] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-cb367675-42aa-4b50-8812-8a73fdef747d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.400028] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-cb367675-42aa-4b50-8812-8a73fdef747d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.401669] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-cb367675-42aa-4b50-8812-8a73fdef747d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.402366] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.402366] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.402366] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.402366] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.402366] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.402366] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('cb367675-42aa-4b50-8812-8a73fdef747d',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.443455] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('62f0dd40-a793-48dd-b62a-abaa0eeebd45',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 631.905931] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.906264] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.906264] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.906479] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.906574] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.906781] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.906941] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.907040] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.907207] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.907288] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.907390] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb367675-42aa-4b50-8812-8a73fdef747d is going to be updated. [ 631.941226] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.941226] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.941226] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.941226] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.941226] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.947311] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.950147] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.950147] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.950147] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.950147] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.950147] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 62f0dd40-a793-48dd-b62a-abaa0eeebd45 is going to be created. [ 631.950682] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb367675-42aa-4b50-8812-8a73fdef747d in Status: IN_PROGRESS for 2s [ 631.975379] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 631.975379] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 631.975550] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 631.975771] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 631.975933] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 631.987982] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 62f0dd40-a793-48dd-b62a-abaa0eeebd45 in Status: UNINITIALIZED for 2s [ 632.005607] env[67094]: INFO networking_nsxv3.common.synchronization [req-ec568885-394f-468a-a6a0-5b3241f06ada req-cfd7377a-5e16-44bc-8f78-2cfba7767765 tempest-ServerActionsTestJSON-785713127 tempest-ServerActionsTestJSON-785713127-project-member] Enqueued Resource ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 with Priority: HIGHEST for action security_group_members [ 632.005979] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 with Priority: HIGHEST for action security_group_members [ 632.006319] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-018c19d8-0b0e-41bd-8f01-0c9c58710c57 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.006467] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.006530] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.006781] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.006945] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.008088] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.008088] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.008253] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.008307] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.008429] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('018c19d8-0b0e-41bd-8f01-0c9c58710c57',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.420089] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock network-657 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.420089] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "network-657" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.420089] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "network-657" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.420782] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "network-657" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.420782] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.420782] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.420782] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.420981] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.421189] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.421389] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 632.421499] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 632.421672] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 632.421788] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 632.421788] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 632.422167] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 632.422167] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 632.445684] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 632.446009] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 632.448434] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 632.448434] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "network-657" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.448434] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock port-4c1d04ba-055a-463d-8cd9-e21c43d121ec taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.448434] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "port-4c1d04ba-055a-463d-8cd9-e21c43d121ec" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.448434] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "port-4c1d04ba-055a-463d-8cd9-e21c43d121ec" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.448434] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "port-4c1d04ba-055a-463d-8cd9-e21c43d121ec" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.448434] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c1d04ba-055a-463d-8cd9-e21c43d121ec',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.511991] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.512141] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.512141] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.512344] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.512442] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.512634] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.512736] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.512804] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.513039] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.513288] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.513288] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 already deleted. [ 632.513288] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.835221] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0881101-1be1-4dbf-ac18-2d54a689202c in Status: SUCCESS [ 632.835346] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.890919] env[67094]: INFO networking_nsxv3.common.synchronization [None req-88a16452-8f10-49f0-8be1-38026236f659 None None] Enqueued Resource ID: b169eb20-64e7-41b5-add3-a883d3f004d5 with Priority: HIGHEST for action port [ 632.891521] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b169eb20-64e7-41b5-add3-a883d3f004d5 with Priority: HIGHEST for action port [ 632.891837] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-b169eb20-64e7-41b5-add3-a883d3f004d5 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.891994] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b169eb20-64e7-41b5-add3-a883d3f004d5" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.892098] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b169eb20-64e7-41b5-add3-a883d3f004d5" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.893168] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b169eb20-64e7-41b5-add3-a883d3f004d5" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.893168] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b169eb20-64e7-41b5-add3-a883d3f004d5',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 632.950657] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.950657] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.951269] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.951460] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.951621] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.951792] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Segment Port 4c1d04ba-055a-463d-8cd9-e21c43d121ec not found, creating... [ 632.952822] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.952822] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.952822] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.952822] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.953060] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.955740] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.955740] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.955740] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.955740] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.955740] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.955740] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Resource: SegmentPort with ID: 4c1d04ba-055a-463d-8cd9-e21c43d121ec is going to be created. [ 632.984943] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 632.985174] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 632.985469] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 632.985617] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 632.985873] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 632.986082] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "port-4c1d04ba-055a-463d-8cd9-e21c43d121ec" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.126243] env[67094]: INFO networking_nsxv3.common.synchronization [req-f4378376-9047-4d28-81b5-3ece2de03da7 req-1318cfff-df9d-4a99-94da-5ad3ebc9a96c tempest-ListServersNegativeTestJSON-1929385440 tempest-ListServersNegativeTestJSON-1929385440-project-member] Enqueued Resource ID: 90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 with Priority: HIGHEST for action security_group_members [ 633.126243] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 with Priority: HIGHEST for action security_group_members [ 633.127304] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.128240] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.128240] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.128240] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.128804] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.131852] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.131852] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.131852] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.131852] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.131852] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.394968] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b169eb20-64e7-41b5-add3-a883d3f004d5 [ 633.395214] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.395359] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.395434] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.395645] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.395729] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.395857] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b169eb20-64e7-41b5-add3-a883d3f004d5 already deleted. [ 633.395912] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b169eb20-64e7-41b5-add3-a883d3f004d5" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.632946] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.633285] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.633438] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.633906] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.634070] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.634370] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.634550] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.634738] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.635024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.635156] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.635274] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 already deleted. [ 633.635395] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.790035] env[67094]: INFO networking_nsxv3.common.synchronization [req-ec568885-394f-468a-a6a0-5b3241f06ada req-4965907f-34a1-4312-90e9-494e265a86ee service nova] Enqueued Resource ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 with Priority: HIGHEST for action security_group_rules [ 633.790035] env[67094]: INFO networking_nsxv3.common.synchronization [req-ec568885-394f-468a-a6a0-5b3241f06ada req-4965907f-34a1-4312-90e9-494e265a86ee service nova] Enqueued Resource ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 with Priority: HIGHEST for action security_group_members [ 633.790181] env[67094]: INFO networking_nsxv3.common.synchronization [req-ec568885-394f-468a-a6a0-5b3241f06ada req-4965907f-34a1-4312-90e9-494e265a86ee service nova] Enqueued Resource ID: 4c1d04ba-055a-463d-8cd9-e21c43d121ec with Priority: HIGHEST for action port [ 633.790623] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 with Priority: HIGHEST for action security_group_rules [ 633.790777] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 with Priority: HIGHEST for action security_group_members [ 633.790860] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4c1d04ba-055a-463d-8cd9-e21c43d121ec with Priority: HIGHEST for action port [ 633.795022] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-018c19d8-0b0e-41bd-8f01-0c9c58710c57 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.795022] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.795022] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.795022] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.795022] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('018c19d8-0b0e-41bd-8f01-0c9c58710c57',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.795022] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-018c19d8-0b0e-41bd-8f01-0c9c58710c57 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.795022] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.795022] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.795022] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.795416] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.795416] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.795416] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.795554] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.795554] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.795612] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('018c19d8-0b0e-41bd-8f01-0c9c58710c57',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.798672] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-4c1d04ba-055a-463d-8cd9-e21c43d121ec taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.798910] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4c1d04ba-055a-463d-8cd9-e21c43d121ec" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.798910] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4c1d04ba-055a-463d-8cd9-e21c43d121ec" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.799128] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4c1d04ba-055a-463d-8cd9-e21c43d121ec" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.799205] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4c1d04ba-055a-463d-8cd9-e21c43d121ec',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.855998] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock network-309 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.856166] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "network-309" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.856259] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "network-309" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.856595] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "network-309" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.856922] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.857207] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.861121] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.861451] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.861614] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.861837] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 633.862385] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 633.862385] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 633.862385] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 633.862385] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 633.862385] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 633.862714] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 633.883031] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 633.883031] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 633.883850] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 633.883850] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "network-309" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.883850] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock port-a6a50f28-9834-4922-9c22-9745e3740b0a taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 633.884055] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "port-a6a50f28-9834-4922-9c22-9745e3740b0a" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 633.884055] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "port-a6a50f28-9834-4922-9c22-9745e3740b0a" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 633.884990] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "port-a6a50f28-9834-4922-9c22-9745e3740b0a" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 633.885256] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6a50f28-9834-4922-9c22-9745e3740b0a',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 633.960641] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: cb367675-42aa-4b50-8812-8a73fdef747d in Status: SUCCESS [ 633.960904] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: cb367675-42aa-4b50-8812-8a73fdef747d deletion is rescheduled due to dependency. [ 633.960941] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-cb367675-42aa-4b50-8812-8a73fdef747d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.999102] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 62f0dd40-a793-48dd-b62a-abaa0eeebd45 in Status: SUCCESS [ 633.999272] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62f0dd40-a793-48dd-b62a-abaa0eeebd45" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 633.999810] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62f0dd40-a793-48dd-b62a-abaa0eeebd45" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.000042] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62f0dd40-a793-48dd-b62a-abaa0eeebd45" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.000226] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.000347] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.000409] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.000554] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.000633] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.000716] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62f0dd40-a793-48dd-b62a-abaa0eeebd45" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.000807] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('62f0dd40-a793-48dd-b62a-abaa0eeebd45',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.301271] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-018c19d8-0b0e-41bd-8f01-0c9c58710c57 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.301406] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.301739] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('018c19d8-0b0e-41bd-8f01-0c9c58710c57',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.302530] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4c1d04ba-055a-463d-8cd9-e21c43d121ec with status ACTIVE [ 634.302726] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.302999] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.302999] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.303125] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.303210] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.303387] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.303475] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.303532] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.303690] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.303763] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.303937] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.306507] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.306507] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.306507] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.306507] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.306507] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4c1d04ba-055a-463d-8cd9-e21c43d121ec is going to be updated. [ 634.335205] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.335353] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.335430] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.336380] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.336380] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.336380] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4c1d04ba-055a-463d-8cd9-e21c43d121ec" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.388122] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.388463] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.388665] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.389000] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.389142] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.389319] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Segment Port a6a50f28-9834-4922-9c22-9745e3740b0a not found, creating... [ 634.389663] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.389854] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.389950] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.390266] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.390411] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.390738] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.390900] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.391053] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.391311] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.391456] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.391615] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Resource: SegmentPort with ID: a6a50f28-9834-4922-9c22-9745e3740b0a is going to be created. [ 634.425884] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.426834] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.426834] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.426834] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.426834] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.427503] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "port-a6a50f28-9834-4922-9c22-9745e3740b0a" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.504709] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-62f0dd40-a793-48dd-b62a-abaa0eeebd45 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.504948] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62f0dd40-a793-48dd-b62a-abaa0eeebd45" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.505011] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62f0dd40-a793-48dd-b62a-abaa0eeebd45" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.505275] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62f0dd40-a793-48dd-b62a-abaa0eeebd45" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.505461] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.505572] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.505638] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.505800] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.505886] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.505981] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62f0dd40-a793-48dd-b62a-abaa0eeebd45" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.506140] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-62f0dd40-a793-48dd-b62a-abaa0eeebd45 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.506239] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62f0dd40-a793-48dd-b62a-abaa0eeebd45" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.506306] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62f0dd40-a793-48dd-b62a-abaa0eeebd45" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.506440] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62f0dd40-a793-48dd-b62a-abaa0eeebd45" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.506588] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 634.506764] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 634.506764] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 634.506958] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 634.507074] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.507162] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62f0dd40-a793-48dd-b62a-abaa0eeebd45" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 634.507260] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('62f0dd40-a793-48dd-b62a-abaa0eeebd45',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 634.808710] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('018c19d8-0b0e-41bd-8f01-0c9c58710c57',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.009995] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 62f0dd40-a793-48dd-b62a-abaa0eeebd45: rpc.has_security_group_logging(os_id): False [ 635.038548] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.038761] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.038761] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.039405] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.039405] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.039405] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.039623] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.039623] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.039691] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.039742] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.039942] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.040071] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.040144] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.040312] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.040385] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.040570] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.040694] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.040751] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.040949] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.041045] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.041240] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 62f0dd40-a793-48dd-b62a-abaa0eeebd45 is going to be created. [ 635.106615] env[67094]: INFO networking_nsxv3.common.synchronization [req-8c30c767-fa7f-4a7c-8d7e-49d8a5baa549 req-faa67163-c40c-4a53-bf9b-4392ba2c7838 tempest-ImagesNegativeTestJSON-679585558 tempest-ImagesNegativeTestJSON-679585558-project-member] Enqueued Resource ID: a5894e01-0dd0-4818-929b-f9f643fa6db0 with Priority: HIGHEST for action security_group_members [ 635.107266] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5894e01-0dd0-4818-929b-f9f643fa6db0 with Priority: HIGHEST for action security_group_members [ 635.107740] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-a5894e01-0dd0-4818-929b-f9f643fa6db0 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.107740] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a5894e01-0dd0-4818-929b-f9f643fa6db0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.108064] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a5894e01-0dd0-4818-929b-f9f643fa6db0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.108442] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a5894e01-0dd0-4818-929b-f9f643fa6db0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.108622] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.108737] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.108837] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.109073] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.109167] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.109233] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a5894e01-0dd0-4818-929b-f9f643fa6db0',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.122800] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.123051] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.123119] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.123343] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.123587] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.133684] env[67094]: INFO networking_nsxv3.common.synchronization [req-f4378376-9047-4d28-81b5-3ece2de03da7 req-0bd3b22e-38f0-4952-a3ae-48cc51fa16a4 service nova] Enqueued Resource ID: 90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 with Priority: HIGHEST for action security_group_rules [ 635.133859] env[67094]: INFO networking_nsxv3.common.synchronization [req-f4378376-9047-4d28-81b5-3ece2de03da7 req-0bd3b22e-38f0-4952-a3ae-48cc51fa16a4 service nova] Enqueued Resource ID: 90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 with Priority: HIGHEST for action security_group_members [ 635.133988] env[67094]: INFO networking_nsxv3.common.synchronization [req-f4378376-9047-4d28-81b5-3ece2de03da7 req-0bd3b22e-38f0-4952-a3ae-48cc51fa16a4 service nova] Enqueued Resource ID: a6a50f28-9834-4922-9c22-9745e3740b0a with Priority: HIGHEST for action port [ 635.134230] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 with Priority: HIGHEST for action security_group_rules [ 635.134362] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 with Priority: HIGHEST for action security_group_members [ 635.134459] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a6a50f28-9834-4922-9c22-9745e3740b0a with Priority: HIGHEST for action port [ 635.134999] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.142498] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.142633] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.144006] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.144141] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.145349] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.145508] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.145549] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.145750] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.145930] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.146064] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.146140] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.146290] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.146388] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.146493] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.150211] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-a6a50f28-9834-4922-9c22-9745e3740b0a taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.150369] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a6a50f28-9834-4922-9c22-9745e3740b0a" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.150513] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a6a50f28-9834-4922-9c22-9745e3740b0a" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.150670] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a6a50f28-9834-4922-9c22-9745e3740b0a" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.150749] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a6a50f28-9834-4922-9c22-9745e3740b0a',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.153125] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 62f0dd40-a793-48dd-b62a-abaa0eeebd45 in Status: IN_PROGRESS for 2s [ 635.311784] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.312069] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.312144] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.312415] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.312513] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.312622] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 is going to be created. [ 635.351254] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.351254] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.351254] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.351254] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.351254] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.369359] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 in Status: UNINITIALIZED for 2s [ 635.611931] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.612275] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.612382] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.613039] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.613039] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.613039] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.613256] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.613256] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.613439] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.613526] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.613628] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5894e01-0dd0-4818-929b-f9f643fa6db0 is going to be updated. [ 635.642963] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.643540] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.643540] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.643540] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.643865] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.652960] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 635.655850] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5894e01-0dd0-4818-929b-f9f643fa6db0 in Status: IN_PROGRESS for 2s [ 635.656974] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.656974] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.656974] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a6a50f28-9834-4922-9c22-9745e3740b0a with status ACTIVE [ 635.656974] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.656974] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.656974] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.656974] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.657942] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.658194] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.658825] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.658825] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.658825] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.658825] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.658975] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.659084] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.659253] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.659913] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.659913] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.659913] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a6a50f28-9834-4922-9c22-9745e3740b0a is going to be updated. [ 635.692119] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 635.692119] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 635.692297] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 635.693110] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 635.694722] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 635.695045] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a6a50f28-9834-4922-9c22-9745e3740b0a" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.163399] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 636.668430] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.668623] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.668724] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.669774] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.669774] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.669774] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 is going to be created. [ 636.697836] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 636.698494] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 636.698494] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 636.698494] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 636.698649] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 636.710835] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 in Status: UNINITIALIZED for 2s [ 637.168975] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 62f0dd40-a793-48dd-b62a-abaa0eeebd45 in Status: SUCCESS [ 637.170067] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-62f0dd40-a793-48dd-b62a-abaa0eeebd45" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.382841] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 in Status: SUCCESS [ 637.383094] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.383281] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.383734] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.383844] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 637.383936] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 637.383992] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 637.384218] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 637.384300] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.384353] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.384451] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('018c19d8-0b0e-41bd-8f01-0c9c58710c57',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 637.669866] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a5894e01-0dd0-4818-929b-f9f643fa6db0 in Status: SUCCESS [ 637.670147] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a5894e01-0dd0-4818-929b-f9f643fa6db0 deletion is rescheduled due to dependency. [ 637.670302] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a5894e01-0dd0-4818-929b-f9f643fa6db0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 637.890403] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('018c19d8-0b0e-41bd-8f01-0c9c58710c57',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 638.392955] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 018c19d8-0b0e-41bd-8f01-0c9c58710c57: rpc.has_security_group_logging(os_id): False [ 638.411269] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.411411] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.411480] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.411728] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.411796] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.412062] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.412163] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.412223] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.412493] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.412493] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.413276] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 is going to be created. [ 638.488205] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.488357] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.488753] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.488753] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.488885] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.502126] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 in Status: IN_PROGRESS for 2s [ 638.721950] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 in Status: SUCCESS [ 638.722164] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.722337] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.722562] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.722758] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 638.722878] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 638.722955] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 638.723196] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 638.723271] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.723315] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 638.723431] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.226142] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.226396] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.226496] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.226709] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.226940] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.227104] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.227151] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.227294] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.227533] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.227533] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.227623] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.227697] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.227787] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.227972] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.228118] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.228212] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.228324] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.228471] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.228549] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.228624] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.228847] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.347492] env[67094]: INFO networking_nsxv3.common.synchronization [req-c42b97d4-818f-41e2-8084-6ef52a829d9d req-29696aad-8916-4bbc-8115-c6d3dafbf191 tempest-ServersTestMultiNic-1403718544 tempest-ServersTestMultiNic-1403718544-project-member] Enqueued Resource ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 with Priority: HIGHEST for action security_group_members [ 639.348122] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 with Priority: HIGHEST for action security_group_members [ 639.348438] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f15f829-bf18-4bc7-bdf2-32c359ef7028 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.348562] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.348631] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.349030] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.349243] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.349382] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.349476] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.349680] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.349804] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.349992] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f15f829-bf18-4bc7-bdf2-32c359ef7028',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.731254] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2: rpc.has_security_group_logging(os_id): False [ 639.757814] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.757814] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.758084] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.758226] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.758289] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.759036] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.759036] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.759036] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.759036] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.759036] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.759385] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.759385] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.759385] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.759497] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.759497] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.759644] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.759731] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.759786] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.759984] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.759984] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.760146] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 is going to be created. [ 639.831937] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.832153] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.832228] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 639.832553] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 639.832992] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 639.852546] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9f15f829-bf18-4bc7-bdf2-32c359ef7028',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 639.855376] env[67094]: INFO networking_nsxv3.common.synchronization [req-c42b97d4-818f-41e2-8084-6ef52a829d9d req-6504c8d8-14ea-4a98-a893-0d9d4dce6e83 tempest-ServersTestMultiNic-1403718544 tempest-ServersTestMultiNic-1403718544-project-member] Enqueued Resource ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 with Priority: HIGHEST for action security_group_members [ 639.856167] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 with Priority: HIGHEST for action security_group_members [ 639.856508] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f15f829-bf18-4bc7-bdf2-32c359ef7028 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 639.856613] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 639.860704] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 in Status: IN_PROGRESS for 2s [ 640.358250] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9f15f829-bf18-4bc7-bdf2-32c359ef7028',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 640.514883] env[67094]: INFO networking_nsxv3.common.synchronization [req-c42b97d4-818f-41e2-8084-6ef52a829d9d req-69feb723-bbab-47f0-895d-32fe9ba1189f tempest-ServersTestMultiNic-1403718544 tempest-ServersTestMultiNic-1403718544-project-member] Enqueued Resource ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 with Priority: HIGHEST for action security_group_members [ 640.514883] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 with Priority: HIGHEST for action security_group_members [ 640.515259] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f15f829-bf18-4bc7-bdf2-32c359ef7028 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.515408] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.520021] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 in Status: SUCCESS [ 640.520021] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.863354] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.864766] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.864766] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.864766] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.864766] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.864766] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 is going to be updated. [ 640.895673] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 640.897041] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 640.899025] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 640.899025] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 640.899025] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 640.911555] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 in Status: IN_PROGRESS for 2s [ 641.032728] env[67094]: INFO networking_nsxv3.common.synchronization [req-f4378376-9047-4d28-81b5-3ece2de03da7 req-6f78a208-436a-4571-b61b-d018db384d04 tempest-ListServersNegativeTestJSON-1929385440 tempest-ListServersNegativeTestJSON-1929385440-project-member] Enqueued Resource ID: 90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 with Priority: HIGHEST for action security_group_members [ 641.033937] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 with Priority: HIGHEST for action security_group_members [ 641.034229] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.034365] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.034436] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.034649] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.034801] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.034908] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.034972] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.035139] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.035224] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.036118] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.040074] env[67094]: INFO networking_nsxv3.common.synchronization [None req-6f25ce98-93ea-48b4-bf3e-7bc9ffac6d88 None None] Enqueued Resource ID: 5deea3cc-ad1e-4482-8af8-2f4a5e58d292 with Priority: HIGHEST for action port [ 641.040302] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5deea3cc-ad1e-4482-8af8-2f4a5e58d292 with Priority: HIGHEST for action port [ 641.040586] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-5deea3cc-ad1e-4482-8af8-2f4a5e58d292 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.040701] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5deea3cc-ad1e-4482-8af8-2f4a5e58d292" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.040763] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5deea3cc-ad1e-4482-8af8-2f4a5e58d292" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.040990] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5deea3cc-ad1e-4482-8af8-2f4a5e58d292" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.042291] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5deea3cc-ad1e-4482-8af8-2f4a5e58d292',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.540521] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.546464] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5deea3cc-ad1e-4482-8af8-2f4a5e58d292 [ 641.548627] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.548627] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.548627] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.548627] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.548627] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.548627] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5deea3cc-ad1e-4482-8af8-2f4a5e58d292 already deleted. [ 641.548627] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5deea3cc-ad1e-4482-8af8-2f4a5e58d292" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.808693] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock network-309 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.808954] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "network-309" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.809097] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "network-309" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.809488] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "network-309" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.809691] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.809878] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.809995] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.813065] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.815019] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.815019] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 641.815019] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 641.815019] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 641.815019] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 641.815019] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 641.815019] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 641.815019] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 641.835569] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 641.835754] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 641.835905] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 641.836096] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "network-309" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 641.836461] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock port-067b9fcb-b4a3-412f-9a74-a9dfc37c7509 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 641.836644] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "port-067b9fcb-b4a3-412f-9a74-a9dfc37c7509" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 641.836778] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "port-067b9fcb-b4a3-412f-9a74-a9dfc37c7509" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 641.837148] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "port-067b9fcb-b4a3-412f-9a74-a9dfc37c7509" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 641.837300] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('067b9fcb-b4a3-412f-9a74-a9dfc37c7509',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 641.875449] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 in Status: SUCCESS [ 641.875693] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.042547] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 642.340011] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.340011] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.340011] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.340319] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.340406] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.340648] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Segment Port 067b9fcb-b4a3-412f-9a74-a9dfc37c7509 not found, creating... [ 642.340848] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.340923] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.341166] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.341344] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.341401] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.341745] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.341745] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.341955] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.342769] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.342956] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.343139] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Resource: SegmentPort with ID: 067b9fcb-b4a3-412f-9a74-a9dfc37c7509 is going to be created. [ 642.367122] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.367369] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.367490] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.367784] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.367979] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.368242] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "port-067b9fcb-b4a3-412f-9a74-a9dfc37c7509" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.546763] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.546763] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.546763] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.547565] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.547565] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.547565] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 is going to be updated. [ 642.593535] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.593535] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.593535] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.593976] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.593976] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.610851] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 in Status: IN_PROGRESS for 2s [ 642.923160] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 in Status: SUCCESS [ 642.923160] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.923160] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.923722] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.923722] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 642.923722] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 642.923857] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 642.923993] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 642.924112] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 642.924228] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f15f829-bf18-4bc7-bdf2-32c359ef7028',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.043662] env[67094]: INFO networking_nsxv3.common.synchronization [None req-544b0d6c-e897-4366-9a71-a34d5be7aa70 None None] Enqueued Resource ID: 664f7ba0-ff5f-4266-8fea-11f69965077e with Priority: HIGHEST for action port [ 643.044573] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 664f7ba0-ff5f-4266-8fea-11f69965077e with Priority: HIGHEST for action port [ 643.045251] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-664f7ba0-ff5f-4266-8fea-11f69965077e taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.046820] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-664f7ba0-ff5f-4266-8fea-11f69965077e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.046902] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-664f7ba0-ff5f-4266-8fea-11f69965077e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.047248] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-664f7ba0-ff5f-4266-8fea-11f69965077e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.047347] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('664f7ba0-ff5f-4266-8fea-11f69965077e',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.077805] env[67094]: INFO networking_nsxv3.common.synchronization [req-f4378376-9047-4d28-81b5-3ece2de03da7 req-9abfc9bb-6927-41c8-806d-d3a44402b645 service nova] Enqueued Resource ID: 90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 with Priority: HIGHEST for action security_group_rules [ 643.078068] env[67094]: INFO networking_nsxv3.common.synchronization [req-f4378376-9047-4d28-81b5-3ece2de03da7 req-9abfc9bb-6927-41c8-806d-d3a44402b645 service nova] Enqueued Resource ID: 90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 with Priority: HIGHEST for action security_group_members [ 643.079191] env[67094]: INFO networking_nsxv3.common.synchronization [req-f4378376-9047-4d28-81b5-3ece2de03da7 req-9abfc9bb-6927-41c8-806d-d3a44402b645 service nova] Enqueued Resource ID: 067b9fcb-b4a3-412f-9a74-a9dfc37c7509 with Priority: HIGHEST for action port [ 643.080109] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 with Priority: HIGHEST for action security_group_rules [ 643.080579] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 with Priority: HIGHEST for action security_group_members [ 643.080579] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 067b9fcb-b4a3-412f-9a74-a9dfc37c7509 with Priority: HIGHEST for action port [ 643.082911] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.082911] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.082911] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.082911] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.082911] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.082911] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.083195] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.085139] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-067b9fcb-b4a3-412f-9a74-a9dfc37c7509 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.085139] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-067b9fcb-b4a3-412f-9a74-a9dfc37c7509" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.085139] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-067b9fcb-b4a3-412f-9a74-a9dfc37c7509" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.085139] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-067b9fcb-b4a3-412f-9a74-a9dfc37c7509" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.085139] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('067b9fcb-b4a3-412f-9a74-a9dfc37c7509',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 643.427616] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.427827] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.429260] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.429260] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.429260] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.429260] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.429260] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.429260] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.429600] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.429600] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.429661] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 is going to be updated. [ 643.467593] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.467593] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.467593] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.467810] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.468935] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.478504] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 in Status: IN_PROGRESS for 2s [ 643.550044] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 664f7ba0-ff5f-4266-8fea-11f69965077e [ 643.550392] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.550468] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.550543] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.550789] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.550842] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.550936] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:664f7ba0-ff5f-4266-8fea-11f69965077e already deleted. [ 643.551029] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-664f7ba0-ff5f-4266-8fea-11f69965077e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.587698] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.587850] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.588052] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 067b9fcb-b4a3-412f-9a74-a9dfc37c7509 with status ACTIVE [ 643.588251] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.588402] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.588454] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.588655] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.588892] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.588892] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.589035] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.589035] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.589207] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.589284] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.589494] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.589572] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.589606] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.589737] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.589810] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.589894] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 067b9fcb-b4a3-412f-9a74-a9dfc37c7509 is going to be updated. [ 643.620234] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.620234] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.620234] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.620562] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.620562] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.620806] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-067b9fcb-b4a3-412f-9a74-a9dfc37c7509" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 643.828225] env[67094]: INFO networking_nsxv3.common.synchronization [None req-d500562e-106f-4909-b06a-df368d50eaa0 None None] Enqueued Resource ID: cbe94a06-69ec-406a-8b8c-9c0a7c633865 with Priority: HIGHEST for action port [ 643.828577] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cbe94a06-69ec-406a-8b8c-9c0a7c633865 with Priority: HIGHEST for action port [ 643.828965] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-cbe94a06-69ec-406a-8b8c-9c0a7c633865 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 643.831166] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cbe94a06-69ec-406a-8b8c-9c0a7c633865" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 643.831255] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cbe94a06-69ec-406a-8b8c-9c0a7c633865" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 643.831567] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cbe94a06-69ec-406a-8b8c-9c0a7c633865" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 643.831659] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cbe94a06-69ec-406a-8b8c-9c0a7c633865',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 644.335673] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cbe94a06-69ec-406a-8b8c-9c0a7c633865 [ 644.336049] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.336183] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.336246] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.336465] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.336552] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.336645] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cbe94a06-69ec-406a-8b8c-9c0a7c633865 already deleted. [ 644.336726] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cbe94a06-69ec-406a-8b8c-9c0a7c633865" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.621571] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 in Status: SUCCESS [ 644.621835] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.622184] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.622318] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.622594] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 644.622726] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 644.622815] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 644.623034] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 644.623129] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 644.623233] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.128561] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.490582] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 in Status: SUCCESS [ 645.491314] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 deletion is rescheduled due to dependency. [ 645.491314] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.491314] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.491572] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.491836] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.491997] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.492108] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.492380] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.492512] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.492708] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f15f829-bf18-4bc7-bdf2-32c359ef7028',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.632413] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.767224] env[67094]: INFO networking_nsxv3.common.synchronization [req-f4378376-9047-4d28-81b5-3ece2de03da7 req-f47c518d-bedf-4564-97b2-c9469f0358cc tempest-ListServersNegativeTestJSON-1929385440 tempest-ListServersNegativeTestJSON-1929385440-project-member] Enqueued Resource ID: 90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 with Priority: HIGHEST for action security_group_members [ 645.767876] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 with Priority: HIGHEST for action security_group_members [ 645.768211] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.768334] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.821629] env[67094]: INFO networking_nsxv3.common.synchronization [None req-6ce42659-d28b-4c85-afb2-e98e8bb9f39c tempest-AttachInterfacesUnderV243Test-1867486125 tempest-AttachInterfacesUnderV243Test-1867486125-project-member] Enqueued Resource ID: 00b541f3-9964-40ec-91e3-e2aa8166f007 with Priority: HIGHEST for action security_group_rules [ 645.821629] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00b541f3-9964-40ec-91e3-e2aa8166f007 with Priority: HIGHEST for action security_group_rules [ 645.821629] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00b541f3-9964-40ec-91e3-e2aa8166f007 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.821780] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00b541f3-9964-40ec-91e3-e2aa8166f007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.821780] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00b541f3-9964-40ec-91e3-e2aa8166f007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.822230] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00b541f3-9964-40ec-91e3-e2aa8166f007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.822230] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00b541f3-9964-40ec-91e3-e2aa8166f007',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 645.977925] env[67094]: INFO networking_nsxv3.common.synchronization [None req-e63854bb-14ea-482c-bc5b-5de79bb28169 tempest-AttachInterfacesUnderV243Test-1867486125 tempest-AttachInterfacesUnderV243Test-1867486125-project-member] Enqueued Resource ID: 00b541f3-9964-40ec-91e3-e2aa8166f007 with Priority: HIGHEST for action security_group_rules [ 645.978670] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00b541f3-9964-40ec-91e3-e2aa8166f007 with Priority: HIGHEST for action security_group_rules [ 645.980065] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00b541f3-9964-40ec-91e3-e2aa8166f007 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.980237] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00b541f3-9964-40ec-91e3-e2aa8166f007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.996893] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.997427] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.997427] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.998086] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.998086] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.998086] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 645.998293] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 645.998293] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 645.998510] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 645.998627] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 645.998798] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 is going to be updated. [ 646.051091] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.051091] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.051091] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.051403] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.051599] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.063400] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 in Status: IN_PROGRESS for 2s [ 646.090219] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock network-309 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.090399] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "network-309" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.090519] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "network-309" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.090804] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "network-309" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.091036] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.091200] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.091302] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.091532] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.091699] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.091917] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 646.092049] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 646.092156] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 646.092266] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 646.092377] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 646.092502] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 646.092630] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 646.115611] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 646.115799] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 646.115855] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 646.117806] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "network-309" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.117806] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock port-e2b8f800-be16-4ffc-89d2-3e0971098022 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.117806] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "port-e2b8f800-be16-4ffc-89d2-3e0971098022" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.117806] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "port-e2b8f800-be16-4ffc-89d2-3e0971098022" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.117806] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "port-e2b8f800-be16-4ffc-89d2-3e0971098022" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.117806] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2b8f800-be16-4ffc-89d2-3e0971098022',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.136104] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.136104] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.136104] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.136104] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.136104] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.136104] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 is going to be updated. [ 646.184414] env[67094]: INFO networking_nsxv3.common.synchronization [None req-8bebf48c-8d59-4af5-be94-2e7f2e9d088c None None] Enqueued Resource ID: 17b121b5-79b3-4a35-a954-285b07073132 with Priority: HIGHEST for action port [ 646.186017] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.186122] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.186164] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.186423] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.186623] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.188832] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17b121b5-79b3-4a35-a954-285b07073132 with Priority: HIGHEST for action port [ 646.189297] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-17b121b5-79b3-4a35-a954-285b07073132 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.189457] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-17b121b5-79b3-4a35-a954-285b07073132" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.189556] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-17b121b5-79b3-4a35-a954-285b07073132" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.190304] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-17b121b5-79b3-4a35-a954-285b07073132" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.190434] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('17b121b5-79b3-4a35-a954-285b07073132',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.200988] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 in Status: IN_PROGRESS for 2s [ 646.342838] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.342984] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.343066] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.343340] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.343442] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.343542] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00b541f3-9964-40ec-91e3-e2aa8166f007 already deleted. [ 646.343625] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00b541f3-9964-40ec-91e3-e2aa8166f007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.343778] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00b541f3-9964-40ec-91e3-e2aa8166f007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.343936] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00b541f3-9964-40ec-91e3-e2aa8166f007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.344038] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00b541f3-9964-40ec-91e3-e2aa8166f007',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 646.620585] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.620986] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.620986] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.621166] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.622039] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.622039] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Segment Port e2b8f800-be16-4ffc-89d2-3e0971098022 not found, creating... [ 646.622039] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.622039] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.622039] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.622406] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.622899] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.623415] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.623678] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.623904] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.625432] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.625432] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.625432] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Resource: SegmentPort with ID: e2b8f800-be16-4ffc-89d2-3e0971098022 is going to be created. [ 646.650820] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.652240] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.652240] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.652240] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.652240] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.652449] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "port-e2b8f800-be16-4ffc-89d2-3e0971098022" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.694486] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 17b121b5-79b3-4a35-a954-285b07073132 [ 646.694486] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.694718] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.694718] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.694837] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.694969] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.695299] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:17b121b5-79b3-4a35-a954-285b07073132 already deleted. [ 646.695299] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-17b121b5-79b3-4a35-a954-285b07073132" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.865641] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 646.865896] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 646.865943] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 646.866313] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 646.866481] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 646.866603] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00b541f3-9964-40ec-91e3-e2aa8166f007 already deleted. [ 646.867662] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00b541f3-9964-40ec-91e3-e2aa8166f007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.358487] env[67094]: INFO networking_nsxv3.common.synchronization [req-f4378376-9047-4d28-81b5-3ece2de03da7 req-45c36ffb-36f1-4c1c-a003-a1415492f23c service nova] Enqueued Resource ID: 90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 with Priority: HIGHEST for action security_group_rules [ 647.358487] env[67094]: INFO networking_nsxv3.common.synchronization [req-f4378376-9047-4d28-81b5-3ece2de03da7 req-45c36ffb-36f1-4c1c-a003-a1415492f23c service nova] Enqueued Resource ID: 90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 with Priority: HIGHEST for action security_group_members [ 647.358487] env[67094]: INFO networking_nsxv3.common.synchronization [req-f4378376-9047-4d28-81b5-3ece2de03da7 req-45c36ffb-36f1-4c1c-a003-a1415492f23c service nova] Enqueued Resource ID: e2b8f800-be16-4ffc-89d2-3e0971098022 with Priority: HIGHEST for action port [ 647.359492] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 with Priority: HIGHEST for action security_group_rules [ 647.360035] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 with Priority: HIGHEST for action security_group_members [ 647.363021] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e2b8f800-be16-4ffc-89d2-3e0971098022 with Priority: HIGHEST for action port [ 647.363021] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.363021] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.363021] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.363021] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.363021] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-e2b8f800-be16-4ffc-89d2-3e0971098022 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.363021] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e2b8f800-be16-4ffc-89d2-3e0971098022" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.363021] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e2b8f800-be16-4ffc-89d2-3e0971098022" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.363021] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e2b8f800-be16-4ffc-89d2-3e0971098022" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.363021] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e2b8f800-be16-4ffc-89d2-3e0971098022',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 647.871017] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e2b8f800-be16-4ffc-89d2-3e0971098022 with status ACTIVE [ 647.871017] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.871017] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.871017] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.871017] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.871017] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.871017] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.871017] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.871017] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.871017] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.871017] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.871017] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.871017] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.871017] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.871910] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.871910] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.871910] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e2b8f800-be16-4ffc-89d2-3e0971098022 is going to be updated. [ 647.900694] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 647.900694] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 647.900694] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 647.900694] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 647.901089] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 647.901089] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e2b8f800-be16-4ffc-89d2-3e0971098022" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.074738] env[67094]: INFO networking_nsxv3.common.synchronization [None req-9188534d-dd3b-4cbf-8a65-79ad6e2f33fa tempest-AttachVolumeTestJSON-829034394 tempest-AttachVolumeTestJSON-829034394-project-member] Enqueued Resource ID: 00f05527-967f-4b60-a2ba-dd3e2d9bad21 with Priority: HIGHEST for action security_group_rules [ 648.077443] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 in Status: SUCCESS [ 648.077443] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 deletion is rescheduled due to dependency. [ 648.077443] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.078262] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00f05527-967f-4b60-a2ba-dd3e2d9bad21 with Priority: HIGHEST for action security_group_rules [ 648.078831] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00f05527-967f-4b60-a2ba-dd3e2d9bad21 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.079607] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00f05527-967f-4b60-a2ba-dd3e2d9bad21" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.079607] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00f05527-967f-4b60-a2ba-dd3e2d9bad21" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.079607] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00f05527-967f-4b60-a2ba-dd3e2d9bad21" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.079607] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00f05527-967f-4b60-a2ba-dd3e2d9bad21',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.213064] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 in Status: SUCCESS [ 648.213636] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.213636] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.213771] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.213874] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.214089] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.214200] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.214458] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.214605] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.214758] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.214944] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.216568] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.216568] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.216568] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.216568] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.216735] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.216784] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.216864] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.220503] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.455813] env[67094]: INFO networking_nsxv3.common.synchronization [None req-591bc46c-557c-4f22-9904-973c4c48a804 tempest-AttachVolumeTestJSON-829034394 tempest-AttachVolumeTestJSON-829034394-project-member] Enqueued Resource ID: 00f05527-967f-4b60-a2ba-dd3e2d9bad21 with Priority: HIGHEST for action security_group_rules [ 648.456491] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00f05527-967f-4b60-a2ba-dd3e2d9bad21 with Priority: HIGHEST for action security_group_rules [ 648.457112] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00f05527-967f-4b60-a2ba-dd3e2d9bad21 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.457344] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00f05527-967f-4b60-a2ba-dd3e2d9bad21" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.817931] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.817931] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 648.817931] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.817931] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.817931] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.817931] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00f05527-967f-4b60-a2ba-dd3e2d9bad21 already deleted. [ 648.817931] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00f05527-967f-4b60-a2ba-dd3e2d9bad21" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 648.817931] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00f05527-967f-4b60-a2ba-dd3e2d9bad21" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 648.817931] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00f05527-967f-4b60-a2ba-dd3e2d9bad21" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 648.817931] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00f05527-967f-4b60-a2ba-dd3e2d9bad21',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.817931] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 648.817931] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 648.817931] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.311334] env[67094]: INFO networking_nsxv3.common.synchronization [req-c5b403f7-ed4d-4892-99ce-1e2e83c9473a req-cbadc4dd-1a03-4cee-bd76-6d2054706fcc tempest-ServerDiagnosticsNegativeTest-1923608985 tempest-ServerDiagnosticsNegativeTest-1923608985-project-member] Enqueued Resource ID: f25d6704-85d6-488c-940d-05693a505db9 with Priority: HIGHEST for action security_group_members [ 649.311883] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f25d6704-85d6-488c-940d-05693a505db9 with Priority: HIGHEST for action security_group_members [ 649.314146] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-f25d6704-85d6-488c-940d-05693a505db9 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.314278] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f25d6704-85d6-488c-940d-05693a505db9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.314349] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f25d6704-85d6-488c-940d-05693a505db9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.315247] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f25d6704-85d6-488c-940d-05693a505db9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.315397] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.315506] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.315584] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.315750] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.315840] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.315935] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f25d6704-85d6-488c-940d-05693a505db9',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.324779] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.343012] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.343127] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.343185] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.343359] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.343431] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.343526] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00f05527-967f-4b60-a2ba-dd3e2d9bad21 already deleted. [ 649.343611] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00f05527-967f-4b60-a2ba-dd3e2d9bad21" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.778426] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock network-653 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.778592] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "network-653" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.778706] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "network-653" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.778961] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "network-653" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.780380] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.780380] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.780380] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.780380] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.780380] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.780380] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 649.780380] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 649.780380] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 649.780380] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 649.780829] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 649.780829] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 649.780829] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 649.801040] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 649.801135] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 649.801199] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 649.801648] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "network-653" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.801915] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock port-6956ac9e-4eaf-4f77-bdb4-723fa08cd4b6 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.801915] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "port-6956ac9e-4eaf-4f77-bdb4-723fa08cd4b6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.802030] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "port-6956ac9e-4eaf-4f77-bdb4-723fa08cd4b6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.802317] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "port-6956ac9e-4eaf-4f77-bdb4-723fa08cd4b6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.802542] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6956ac9e-4eaf-4f77-bdb4-723fa08cd4b6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 649.822125] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.822784] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.822784] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.822784] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.822973] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.823410] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.823410] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.823410] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.823410] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.823655] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.823655] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f25d6704-85d6-488c-940d-05693a505db9 already deleted. [ 649.823655] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f25d6704-85d6-488c-940d-05693a505db9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.824424] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.824424] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.824424] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.824424] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.824424] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.824614] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 is going to be updated. [ 649.862362] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 649.862362] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 649.862362] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 649.862362] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 649.862780] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 649.874482] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 in Status: IN_PROGRESS for 2s [ 650.305229] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.305852] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.306136] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.306664] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.306942] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.307239] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Segment Port 6956ac9e-4eaf-4f77-bdb4-723fa08cd4b6 not found, creating... [ 650.307677] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.307964] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.308200] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.308553] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.308783] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.309296] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.309576] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.309788] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.310177] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.310415] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.310663] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Resource: SegmentPort with ID: 6956ac9e-4eaf-4f77-bdb4-723fa08cd4b6 is going to be created. [ 650.340775] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 650.341291] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 650.341356] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 650.341740] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 650.342136] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 650.342461] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "port-6956ac9e-4eaf-4f77-bdb4-723fa08cd4b6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.188289] env[67094]: INFO networking_nsxv3.common.synchronization [req-c5b403f7-ed4d-4892-99ce-1e2e83c9473a req-81558281-42b8-41c2-9d7d-62ea897a8404 service nova] Enqueued Resource ID: f25d6704-85d6-488c-940d-05693a505db9 with Priority: HIGHEST for action security_group_rules [ 651.188289] env[67094]: INFO networking_nsxv3.common.synchronization [req-c5b403f7-ed4d-4892-99ce-1e2e83c9473a req-81558281-42b8-41c2-9d7d-62ea897a8404 service nova] Enqueued Resource ID: f25d6704-85d6-488c-940d-05693a505db9 with Priority: HIGHEST for action security_group_members [ 651.188289] env[67094]: INFO networking_nsxv3.common.synchronization [req-c5b403f7-ed4d-4892-99ce-1e2e83c9473a req-81558281-42b8-41c2-9d7d-62ea897a8404 service nova] Enqueued Resource ID: 6956ac9e-4eaf-4f77-bdb4-723fa08cd4b6 with Priority: HIGHEST for action port [ 651.188289] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f25d6704-85d6-488c-940d-05693a505db9 with Priority: HIGHEST for action security_group_rules [ 651.188289] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f25d6704-85d6-488c-940d-05693a505db9 with Priority: HIGHEST for action security_group_members [ 651.188683] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6956ac9e-4eaf-4f77-bdb4-723fa08cd4b6 with Priority: HIGHEST for action port [ 651.189450] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f25d6704-85d6-488c-940d-05693a505db9 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.189759] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f25d6704-85d6-488c-940d-05693a505db9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.189925] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f25d6704-85d6-488c-940d-05693a505db9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.190412] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f25d6704-85d6-488c-940d-05693a505db9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.190613] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f25d6704-85d6-488c-940d-05693a505db9',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.192286] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-f25d6704-85d6-488c-940d-05693a505db9 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.192548] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f25d6704-85d6-488c-940d-05693a505db9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.192901] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f25d6704-85d6-488c-940d-05693a505db9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.193302] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f25d6704-85d6-488c-940d-05693a505db9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.193565] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.194252] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.195140] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.195438] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.195622] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.201247] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f25d6704-85d6-488c-940d-05693a505db9',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.201247] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-6956ac9e-4eaf-4f77-bdb4-723fa08cd4b6 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.201247] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6956ac9e-4eaf-4f77-bdb4-723fa08cd4b6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.201247] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6956ac9e-4eaf-4f77-bdb4-723fa08cd4b6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.201247] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6956ac9e-4eaf-4f77-bdb4-723fa08cd4b6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.201247] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6956ac9e-4eaf-4f77-bdb4-723fa08cd4b6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.705026] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f25d6704-85d6-488c-940d-05693a505db9',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.705026] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-f25d6704-85d6-488c-940d-05693a505db9 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.705026] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f25d6704-85d6-488c-940d-05693a505db9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.705026] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6956ac9e-4eaf-4f77-bdb4-723fa08cd4b6 with status ACTIVE [ 651.705026] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.705026] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.705026] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.705026] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.705026] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.705026] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.705026] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.705026] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.705026] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.706578] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.706929] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.707324] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.707532] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.707838] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.709646] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.709646] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6956ac9e-4eaf-4f77-bdb4-723fa08cd4b6 is going to be updated. [ 651.733517] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.733517] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.733517] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.733517] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.733517] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.733517] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6956ac9e-4eaf-4f77-bdb4-723fa08cd4b6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.835236] env[67094]: INFO networking_nsxv3.common.synchronization [req-75a6e14c-bce7-4fea-a696-ff0bfa03403a req-63867317-0728-4d6b-95e8-a58c7adf3786 tempest-ListImageFiltersTestJSON-2012211862 tempest-ListImageFiltersTestJSON-2012211862-project-member] Enqueued Resource ID: 0ee9080c-8cce-48e3-86d7-285fa4431dd0 with Priority: HIGHEST for action security_group_members [ 651.836238] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ee9080c-8cce-48e3-86d7-285fa4431dd0 with Priority: HIGHEST for action security_group_members [ 651.837431] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ee9080c-8cce-48e3-86d7-285fa4431dd0 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.837852] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.838720] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.838720] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.838720] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.839036] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.839036] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.839469] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.839469] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.839599] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ee9080c-8cce-48e3-86d7-285fa4431dd0',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 651.886529] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 in Status: SUCCESS [ 651.886782] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.887408] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.887408] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.888378] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 651.888604] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 651.888737] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 651.889362] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 651.889515] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 651.889673] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.204087] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f25d6704-85d6-488c-940d-05693a505db9',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.343290] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.343561] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.343686] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.344046] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.344225] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.344426] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.344558] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.344655] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.344862] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.345239] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.345324] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ee9080c-8cce-48e3-86d7-285fa4431dd0 already deleted. [ 652.345430] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.394412] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.466284] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock network-653 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.466284] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "network-653" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.466284] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "network-653" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.466284] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "network-653" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.467129] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.468132] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.468619] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.468619] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.468741] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.469294] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 652.469294] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 652.469294] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 652.469490] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 652.469490] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 652.469731] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 652.469731] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 652.497735] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 652.497735] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 652.497735] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 652.497735] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "network-653" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.497735] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock port-2768fef9-e82d-4ceb-8349-3302e83dceca taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.497735] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "port-2768fef9-e82d-4ceb-8349-3302e83dceca" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.497735] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "port-2768fef9-e82d-4ceb-8349-3302e83dceca" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.497735] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "port-2768fef9-e82d-4ceb-8349-3302e83dceca" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.497735] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2768fef9-e82d-4ceb-8349-3302e83dceca',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.706458] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.706881] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.706881] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.707068] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.707146] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.707251] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f25d6704-85d6-488c-940d-05693a505db9 is going to be created. [ 652.741011] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.741011] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.741011] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.741011] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.741011] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 652.751046] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f25d6704-85d6-488c-940d-05693a505db9 in Status: UNINITIALIZED for 2s [ 652.835436] env[67094]: INFO networking_nsxv3.common.synchronization [None req-19b6f7aa-7ec6-4c24-8a73-4d85f0beea15 None None] Enqueued Resource ID: d54b7c67-3e6f-4c72-b65d-ae59a1d820fb with Priority: HIGHEST for action port [ 652.835436] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d54b7c67-3e6f-4c72-b65d-ae59a1d820fb with Priority: HIGHEST for action port [ 652.835774] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-d54b7c67-3e6f-4c72-b65d-ae59a1d820fb taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 652.835918] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d54b7c67-3e6f-4c72-b65d-ae59a1d820fb" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 652.835989] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d54b7c67-3e6f-4c72-b65d-ae59a1d820fb" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 652.836316] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d54b7c67-3e6f-4c72-b65d-ae59a1d820fb" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 652.836434] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d54b7c67-3e6f-4c72-b65d-ae59a1d820fb',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 652.895739] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 653.000364] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.000575] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.000575] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.000827] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.000974] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.001136] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Segment Port 2768fef9-e82d-4ceb-8349-3302e83dceca not found, creating... [ 653.001385] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.001532] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.001637] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.001844] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.001984] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.002310] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.002443] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.002549] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.002745] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.002873] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.003017] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Resource: SegmentPort with ID: 2768fef9-e82d-4ceb-8349-3302e83dceca is going to be created. [ 653.023826] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.024048] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.024173] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.024450] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.024708] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.024990] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "port-2768fef9-e82d-4ceb-8349-3302e83dceca" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.339391] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port d54b7c67-3e6f-4c72-b65d-ae59a1d820fb [ 653.339642] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.339801] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.339942] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.340100] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.340196] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.340302] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:d54b7c67-3e6f-4c72-b65d-ae59a1d820fb already deleted. [ 653.340437] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d54b7c67-3e6f-4c72-b65d-ae59a1d820fb" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.398819] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.399157] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.399210] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.399517] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.399657] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.399815] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 is going to be updated. [ 653.437702] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 653.437877] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 653.437969] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 653.438322] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 653.438404] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 653.448808] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 in Status: IN_PROGRESS for 2s [ 654.100664] env[67094]: INFO networking_nsxv3.common.synchronization [req-75a6e14c-bce7-4fea-a696-ff0bfa03403a req-98b38a32-e37a-4f3d-a0d9-7b6b5d12681a service nova] Enqueued Resource ID: 0ee9080c-8cce-48e3-86d7-285fa4431dd0 with Priority: HIGHEST for action security_group_rules [ 654.100664] env[67094]: INFO networking_nsxv3.common.synchronization [req-75a6e14c-bce7-4fea-a696-ff0bfa03403a req-98b38a32-e37a-4f3d-a0d9-7b6b5d12681a service nova] Enqueued Resource ID: 0ee9080c-8cce-48e3-86d7-285fa4431dd0 with Priority: HIGHEST for action security_group_members [ 654.100664] env[67094]: INFO networking_nsxv3.common.synchronization [req-75a6e14c-bce7-4fea-a696-ff0bfa03403a req-98b38a32-e37a-4f3d-a0d9-7b6b5d12681a service nova] Enqueued Resource ID: 2768fef9-e82d-4ceb-8349-3302e83dceca with Priority: HIGHEST for action port [ 654.100664] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ee9080c-8cce-48e3-86d7-285fa4431dd0 with Priority: HIGHEST for action security_group_rules [ 654.100664] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ee9080c-8cce-48e3-86d7-285fa4431dd0 with Priority: HIGHEST for action security_group_members [ 654.100664] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2768fef9-e82d-4ceb-8349-3302e83dceca with Priority: HIGHEST for action port [ 654.100664] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ee9080c-8cce-48e3-86d7-285fa4431dd0 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.100664] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.100664] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.101241] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.101241] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ee9080c-8cce-48e3-86d7-285fa4431dd0',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.103401] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ee9080c-8cce-48e3-86d7-285fa4431dd0 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.103529] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.103589] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.103820] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.103981] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.104101] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.104177] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.104346] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.104430] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.104523] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ee9080c-8cce-48e3-86d7-285fa4431dd0',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.106605] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-2768fef9-e82d-4ceb-8349-3302e83dceca taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.106605] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2768fef9-e82d-4ceb-8349-3302e83dceca" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.106605] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2768fef9-e82d-4ceb-8349-3302e83dceca" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.106605] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2768fef9-e82d-4ceb-8349-3302e83dceca" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.106605] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2768fef9-e82d-4ceb-8349-3302e83dceca',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.609908] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ee9080c-8cce-48e3-86d7-285fa4431dd0 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.609908] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.609908] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0ee9080c-8cce-48e3-86d7-285fa4431dd0',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 654.610814] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2768fef9-e82d-4ceb-8349-3302e83dceca with status ACTIVE [ 654.611794] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.611794] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.611794] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.611794] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.612156] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.612344] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.612455] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.612518] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.613174] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.613174] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.613331] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.613444] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.613444] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.613560] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.613862] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.613862] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2768fef9-e82d-4ceb-8349-3302e83dceca is going to be updated. [ 654.638299] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.638299] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.639213] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.639476] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.639633] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.639809] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2768fef9-e82d-4ceb-8349-3302e83dceca" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.769024] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f25d6704-85d6-488c-940d-05693a505db9 in Status: SUCCESS [ 654.769024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f25d6704-85d6-488c-940d-05693a505db9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.769024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f25d6704-85d6-488c-940d-05693a505db9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.769024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f25d6704-85d6-488c-940d-05693a505db9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.769024] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 654.769024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 654.769024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 654.769024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 654.769024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.769024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f25d6704-85d6-488c-940d-05693a505db9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 654.769024] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f25d6704-85d6-488c-940d-05693a505db9',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.115630] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0ee9080c-8cce-48e3-86d7-285fa4431dd0',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.273673] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-f25d6704-85d6-488c-940d-05693a505db9 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.273848] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f25d6704-85d6-488c-940d-05693a505db9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.275128] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f25d6704-85d6-488c-940d-05693a505db9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.275128] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f25d6704-85d6-488c-940d-05693a505db9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.275128] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.275128] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.275128] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.275128] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.275823] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.278534] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f25d6704-85d6-488c-940d-05693a505db9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.278534] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-f25d6704-85d6-488c-940d-05693a505db9 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.278534] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f25d6704-85d6-488c-940d-05693a505db9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.278534] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f25d6704-85d6-488c-940d-05693a505db9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.278534] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f25d6704-85d6-488c-940d-05693a505db9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.278534] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.278534] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.278534] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.280465] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.280555] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.280755] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f25d6704-85d6-488c-940d-05693a505db9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.280828] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f25d6704-85d6-488c-940d-05693a505db9',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.462812] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 in Status: SUCCESS [ 655.462983] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.463260] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.463457] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.463694] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.464049] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.464049] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.464551] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.464551] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.464551] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.465034] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.465034] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.466045] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.466323] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.466550] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.466692] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.466787] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.466988] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.467193] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.467316] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.467442] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.618995] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.618995] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.618995] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.619281] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.619281] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.619379] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ee9080c-8cce-48e3-86d7-285fa4431dd0 is going to be created. [ 655.644816] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.644816] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.645016] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.645103] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.645707] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.658497] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ee9080c-8cce-48e3-86d7-285fa4431dd0 in Status: UNINITIALIZED for 2s [ 655.732664] env[67094]: INFO networking_nsxv3.common.synchronization [None req-cf253528-8852-45b9-bca4-8301398af698 None None] Enqueued Resource ID: 04f0b319-d66b-412b-99a1-98e099c93e81 with Priority: HIGHEST for action port [ 655.736023] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04f0b319-d66b-412b-99a1-98e099c93e81 with Priority: HIGHEST for action port [ 655.736023] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-04f0b319-d66b-412b-99a1-98e099c93e81 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.736023] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-04f0b319-d66b-412b-99a1-98e099c93e81" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.736023] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-04f0b319-d66b-412b-99a1-98e099c93e81" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.736023] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-04f0b319-d66b-412b-99a1-98e099c93e81" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.736023] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04f0b319-d66b-412b-99a1-98e099c93e81',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 655.784654] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f25d6704-85d6-488c-940d-05693a505db9: rpc.has_security_group_logging(os_id): False [ 655.802919] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.803089] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.803164] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.803570] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.803765] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.803833] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.804200] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.804275] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.804446] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.804711] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.804878] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.805149] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.805192] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.805325] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.805493] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.805595] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.805673] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.805731] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.805876] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.805962] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.806102] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f25d6704-85d6-488c-940d-05693a505db9 is going to be created. [ 655.908598] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.909015] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.909015] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.911280] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.911280] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.942044] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f25d6704-85d6-488c-940d-05693a505db9 in Status: IN_PROGRESS for 2s [ 655.973051] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2: rpc.has_security_group_logging(os_id): False [ 655.994657] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.994657] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.994657] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.994995] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.994995] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.995102] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.995181] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.995371] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.995371] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.995553] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.995684] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.995891] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.995891] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.996143] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.996143] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.996232] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 655.996287] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 655.996348] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 655.996508] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 655.996555] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 655.996648] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 is going to be updated. [ 656.089684] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.089867] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.089948] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.090210] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.090343] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.109480] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 in Status: IN_PROGRESS for 2s [ 656.240337] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 04f0b319-d66b-412b-99a1-98e099c93e81 [ 656.240337] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.240337] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.240337] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.240337] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.240337] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.240337] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:04f0b319-d66b-412b-99a1-98e099c93e81 already deleted. [ 656.240337] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-04f0b319-d66b-412b-99a1-98e099c93e81" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.548246] env[67094]: INFO networking_nsxv3.common.synchronization [req-953db1e2-3d83-4bb9-b2fd-21edbd4172f8 req-7e6b7f28-f111-496c-8e8b-1c7887a21da5 tempest-ServersWithSpecificFlavorTestJSON-602104183 tempest-ServersWithSpecificFlavorTestJSON-602104183-project-member] Enqueued Resource ID: 60943622-73b5-4dda-ad21-63bf08db617e with Priority: HIGHEST for action security_group_members [ 656.548246] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60943622-73b5-4dda-ad21-63bf08db617e with Priority: HIGHEST for action security_group_members [ 656.548246] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-60943622-73b5-4dda-ad21-63bf08db617e taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.548246] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60943622-73b5-4dda-ad21-63bf08db617e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.548246] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60943622-73b5-4dda-ad21-63bf08db617e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.548925] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60943622-73b5-4dda-ad21-63bf08db617e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.549341] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 656.550632] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 656.550910] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 656.551222] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 656.551416] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 656.551630] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60943622-73b5-4dda-ad21-63bf08db617e',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.055760] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.055940] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.056072] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.056246] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.056338] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.056539] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.056639] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.056709] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.056862] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.056939] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.057171] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60943622-73b5-4dda-ad21-63bf08db617e already deleted. [ 657.057398] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60943622-73b5-4dda-ad21-63bf08db617e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.118753] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock network-661 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.119156] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "network-661" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.119285] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "network-661" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.119691] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "network-661" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.120074] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.120290] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.120442] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.120730] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.120922] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.121441] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 657.121586] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 657.121780] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 657.121991] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 657.122143] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 657.122255] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 657.122384] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 657.143755] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 657.143926] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 657.144070] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 657.144244] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "network-661" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.144554] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock port-d4cf75e3-421d-4b08-8a59-1973e54eae3b taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.144720] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "port-d4cf75e3-421d-4b08-8a59-1973e54eae3b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.144824] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "port-d4cf75e3-421d-4b08-8a59-1973e54eae3b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.145152] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "port-d4cf75e3-421d-4b08-8a59-1973e54eae3b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.145297] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d4cf75e3-421d-4b08-8a59-1973e54eae3b',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.390068] env[67094]: INFO networking_nsxv3.common.synchronization [None req-9b70eee5-8f6b-4d22-856c-286d5a24399d tempest-AttachInterfacesTestJSON-1117082489 tempest-AttachInterfacesTestJSON-1117082489-project-member] Enqueued Resource ID: eb77eddf-2e1d-485c-bfe8-67d4c174dc73 with Priority: HIGHEST for action security_group_rules [ 657.390826] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb77eddf-2e1d-485c-bfe8-67d4c174dc73 with Priority: HIGHEST for action security_group_rules [ 657.390826] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eb77eddf-2e1d-485c-bfe8-67d4c174dc73 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.391120] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eb77eddf-2e1d-485c-bfe8-67d4c174dc73" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.391120] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eb77eddf-2e1d-485c-bfe8-67d4c174dc73" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.391379] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eb77eddf-2e1d-485c-bfe8-67d4c174dc73" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.391513] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eb77eddf-2e1d-485c-bfe8-67d4c174dc73',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.648475] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.653024] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.653024] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.653024] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.653024] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.653024] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Segment Port d4cf75e3-421d-4b08-8a59-1973e54eae3b not found, creating... [ 657.653024] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.653024] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.653024] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.653024] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.653024] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.653498] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.653498] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.653498] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.653498] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.653498] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.653498] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Resource: SegmentPort with ID: d4cf75e3-421d-4b08-8a59-1973e54eae3b is going to be created. [ 657.670882] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ee9080c-8cce-48e3-86d7-285fa4431dd0 in Status: SUCCESS [ 657.671340] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.672134] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.673379] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.673379] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.673379] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.673379] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.673379] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.673379] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.673379] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.673379] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0ee9080c-8cce-48e3-86d7-285fa4431dd0',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.681052] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.681052] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.681209] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.681966] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.681966] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.681966] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "port-d4cf75e3-421d-4b08-8a59-1973e54eae3b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.903295] env[67094]: INFO networking_nsxv3.common.synchronization [None req-912f6c0f-bca1-4f78-90a4-3b0cae95503e tempest-AttachInterfacesTestJSON-1117082489 tempest-AttachInterfacesTestJSON-1117082489-project-member] Enqueued Resource ID: eb77eddf-2e1d-485c-bfe8-67d4c174dc73 with Priority: HIGHEST for action security_group_rules [ 657.904227] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb77eddf-2e1d-485c-bfe8-67d4c174dc73 with Priority: HIGHEST for action security_group_rules [ 657.904227] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eb77eddf-2e1d-485c-bfe8-67d4c174dc73 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.904427] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eb77eddf-2e1d-485c-bfe8-67d4c174dc73" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.919232] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 657.919764] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 657.919886] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.920179] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.920326] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.920434] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eb77eddf-2e1d-485c-bfe8-67d4c174dc73 already deleted. [ 657.920500] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eb77eddf-2e1d-485c-bfe8-67d4c174dc73" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 657.921331] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eb77eddf-2e1d-485c-bfe8-67d4c174dc73" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 657.921790] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eb77eddf-2e1d-485c-bfe8-67d4c174dc73" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 657.923412] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eb77eddf-2e1d-485c-bfe8-67d4c174dc73',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 657.956597] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f25d6704-85d6-488c-940d-05693a505db9 in Status: SUCCESS [ 657.956844] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f25d6704-85d6-488c-940d-05693a505db9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.124276] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 in Status: SUCCESS [ 658.124276] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.124276] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.124276] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.124276] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.182808] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ee9080c-8cce-48e3-86d7-285fa4431dd0 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.182808] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.182808] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.182808] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.182808] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.182808] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.182808] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.182808] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.182808] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.182808] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.182808] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ee9080c-8cce-48e3-86d7-285fa4431dd0 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.182808] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.182808] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.182808] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.182808] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.182808] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.184072] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.184072] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.184072] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.184072] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.184072] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0ee9080c-8cce-48e3-86d7-285fa4431dd0',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.429993] env[67094]: INFO networking_nsxv3.common.synchronization [req-953db1e2-3d83-4bb9-b2fd-21edbd4172f8 req-57582433-675b-414b-ad0f-517dfaa2134d service nova] Enqueued Resource ID: 60943622-73b5-4dda-ad21-63bf08db617e with Priority: HIGHEST for action security_group_rules [ 658.429993] env[67094]: INFO networking_nsxv3.common.synchronization [req-953db1e2-3d83-4bb9-b2fd-21edbd4172f8 req-57582433-675b-414b-ad0f-517dfaa2134d service nova] Enqueued Resource ID: 60943622-73b5-4dda-ad21-63bf08db617e with Priority: HIGHEST for action security_group_members [ 658.430400] env[67094]: INFO networking_nsxv3.common.synchronization [req-953db1e2-3d83-4bb9-b2fd-21edbd4172f8 req-57582433-675b-414b-ad0f-517dfaa2134d service nova] Enqueued Resource ID: d4cf75e3-421d-4b08-8a59-1973e54eae3b with Priority: HIGHEST for action port [ 658.430400] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60943622-73b5-4dda-ad21-63bf08db617e with Priority: HIGHEST for action security_group_rules [ 658.430513] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60943622-73b5-4dda-ad21-63bf08db617e with Priority: HIGHEST for action security_group_members [ 658.430570] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d4cf75e3-421d-4b08-8a59-1973e54eae3b with Priority: HIGHEST for action port [ 658.431170] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-60943622-73b5-4dda-ad21-63bf08db617e taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.431327] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-60943622-73b5-4dda-ad21-63bf08db617e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.431327] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-60943622-73b5-4dda-ad21-63bf08db617e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.431683] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-60943622-73b5-4dda-ad21-63bf08db617e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.431683] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('60943622-73b5-4dda-ad21-63bf08db617e',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.433366] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-60943622-73b5-4dda-ad21-63bf08db617e taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.433366] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60943622-73b5-4dda-ad21-63bf08db617e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.433366] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60943622-73b5-4dda-ad21-63bf08db617e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.433562] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60943622-73b5-4dda-ad21-63bf08db617e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.435739] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.435739] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.435739] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.435739] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.435739] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.435739] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60943622-73b5-4dda-ad21-63bf08db617e',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.436448] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-d4cf75e3-421d-4b08-8a59-1973e54eae3b taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.436448] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d4cf75e3-421d-4b08-8a59-1973e54eae3b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.436448] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d4cf75e3-421d-4b08-8a59-1973e54eae3b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.436448] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d4cf75e3-421d-4b08-8a59-1973e54eae3b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.436448] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d4cf75e3-421d-4b08-8a59-1973e54eae3b',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.447108] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.447291] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.447375] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.447953] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.448089] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.448197] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eb77eddf-2e1d-485c-bfe8-67d4c174dc73 already deleted. [ 658.448300] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eb77eddf-2e1d-485c-bfe8-67d4c174dc73" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.626796] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.626995] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.627148] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.627385] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.627565] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.627672] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.627749] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.627954] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.628060] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.628120] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.628199] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.688343] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0ee9080c-8cce-48e3-86d7-285fa4431dd0: rpc.has_security_group_logging(os_id): False [ 658.707799] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.710050] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.710050] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.710050] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.710050] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.710050] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.710050] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.710050] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.710050] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.710050] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.710050] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.710050] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.710050] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.710050] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.710050] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.710985] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.713519] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.713519] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.713519] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.713519] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.713519] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ee9080c-8cce-48e3-86d7-285fa4431dd0 is going to be created. [ 658.774032] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.774032] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.774032] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.774032] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.774032] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.786715] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0ee9080c-8cce-48e3-86d7-285fa4431dd0 in Status: IN_PROGRESS for 2s [ 658.933975] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-60943622-73b5-4dda-ad21-63bf08db617e taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.934263] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60943622-73b5-4dda-ad21-63bf08db617e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.936906] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('60943622-73b5-4dda-ad21-63bf08db617e',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 658.940837] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d4cf75e3-421d-4b08-8a59-1973e54eae3b with status ACTIVE [ 658.940837] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.940837] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.940837] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.940837] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.940837] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.941598] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.941905] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.942111] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.942419] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.942630] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.943067] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.945035] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.945035] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.945035] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.945035] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.945035] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d4cf75e3-421d-4b08-8a59-1973e54eae3b is going to be updated. [ 658.982548] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 658.982548] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 658.982548] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 658.982548] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 658.982548] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 658.982548] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d4cf75e3-421d-4b08-8a59-1973e54eae3b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.132078] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.132671] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.132671] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.132877] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.132921] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.133085] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.133181] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.133441] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.133515] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.133599] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.133599] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.133599] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.133599] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.133599] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.133599] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.133599] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.133599] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.133599] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.135184] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.135184] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.135184] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.449152] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('60943622-73b5-4dda-ad21-63bf08db617e',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.643714] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2: rpc.has_security_group_logging(os_id): False [ 659.662456] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.662626] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.662679] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.663739] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.663739] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.663739] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.663739] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.663739] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.663739] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.663739] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.664126] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.664126] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.664126] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.664578] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.664578] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.664578] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.664578] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.664578] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.664840] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.664840] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.665075] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 is going to be updated. [ 659.689434] env[67094]: INFO networking_nsxv3.common.synchronization [None req-3414e05b-4692-48ec-bcf0-bd41086dfd94 None None] Enqueued Resource ID: 29e85362-311c-4b4b-8aa9-496631e479af with Priority: HIGHEST for action port [ 659.689434] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29e85362-311c-4b4b-8aa9-496631e479af with Priority: HIGHEST for action port [ 659.689964] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-29e85362-311c-4b4b-8aa9-496631e479af taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.690948] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-29e85362-311c-4b4b-8aa9-496631e479af" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.691829] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-29e85362-311c-4b4b-8aa9-496631e479af" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.692741] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-29e85362-311c-4b4b-8aa9-496631e479af" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.693136] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('29e85362-311c-4b4b-8aa9-496631e479af',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 659.734795] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.734795] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.734795] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.734795] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.734795] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.767320] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 in Status: IN_PROGRESS for 2s [ 659.950617] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.950617] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.950617] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.951476] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.951476] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.951476] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60943622-73b5-4dda-ad21-63bf08db617e is going to be created. [ 659.986148] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 659.986148] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 659.986148] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 659.986148] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 659.986148] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 659.996196] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60943622-73b5-4dda-ad21-63bf08db617e in Status: UNINITIALIZED for 2s [ 660.199740] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 29e85362-311c-4b4b-8aa9-496631e479af [ 660.199740] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.199740] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.199740] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.199740] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.199740] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.199740] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:29e85362-311c-4b4b-8aa9-496631e479af already deleted. [ 660.199740] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-29e85362-311c-4b4b-8aa9-496631e479af" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.423406] env[67094]: INFO networking_nsxv3.common.synchronization [req-17cbc7bf-0662-4b0c-a396-22c21d735668 req-2ef4f091-09b8-4634-9e83-74c0755a9a51 tempest-ListImageFiltersTestJSON-2012211862 tempest-ListImageFiltersTestJSON-2012211862-project-member] Enqueued Resource ID: 0ee9080c-8cce-48e3-86d7-285fa4431dd0 with Priority: HIGHEST for action security_group_members [ 660.423406] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ee9080c-8cce-48e3-86d7-285fa4431dd0 with Priority: HIGHEST for action security_group_members [ 660.424068] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ee9080c-8cce-48e3-86d7-285fa4431dd0 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.424395] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.424565] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.424875] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.425194] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.425438] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.425620] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.425884] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.426080] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.426262] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ee9080c-8cce-48e3-86d7-285fa4431dd0',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.801014] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0ee9080c-8cce-48e3-86d7-285fa4431dd0 in Status: SUCCESS [ 660.801338] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.929826] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0ee9080c-8cce-48e3-86d7-285fa4431dd0',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 660.981378] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock network-653 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.981951] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "network-653" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.985114] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "network-653" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.985114] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "network-653" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.985114] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 660.985114] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 660.985114] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 660.985114] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 660.985114] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 660.985114] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 660.985114] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 660.985114] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 660.985114] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 660.985114] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 660.985114] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 660.985114] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 661.009061] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 661.009561] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 661.009821] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 661.010153] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "network-653" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.010599] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock port-df2e1495-68af-45a6-9f83-1cd83a645036 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.011032] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "port-df2e1495-68af-45a6-9f83-1cd83a645036" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.011324] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "port-df2e1495-68af-45a6-9f83-1cd83a645036" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.011749] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "port-df2e1495-68af-45a6-9f83-1cd83a645036" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.012015] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df2e1495-68af-45a6-9f83-1cd83a645036',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.433946] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0ee9080c-8cce-48e3-86d7-285fa4431dd0',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 661.515169] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.515440] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.515564] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.515844] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.515989] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.516157] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Segment Port df2e1495-68af-45a6-9f83-1cd83a645036 not found, creating... [ 661.516416] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.516564] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.516672] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.517214] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.517363] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.517645] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.517793] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.517905] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.518662] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.518843] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.519025] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Resource: SegmentPort with ID: df2e1495-68af-45a6-9f83-1cd83a645036 is going to be created. [ 661.541415] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.541791] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.542031] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.542413] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.542666] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.542893] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "port-df2e1495-68af-45a6-9f83-1cd83a645036" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.781976] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 in Status: SUCCESS [ 661.782536] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.937442] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.938569] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.938569] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.938569] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.938569] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.938569] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ee9080c-8cce-48e3-86d7-285fa4431dd0 is going to be updated. [ 661.970415] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 661.970415] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 661.970607] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 661.970762] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 661.970872] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 661.981102] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ee9080c-8cce-48e3-86d7-285fa4431dd0 in Status: IN_PROGRESS for 2s [ 662.009418] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60943622-73b5-4dda-ad21-63bf08db617e in Status: SUCCESS [ 662.009673] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60943622-73b5-4dda-ad21-63bf08db617e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.010740] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60943622-73b5-4dda-ad21-63bf08db617e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.010740] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60943622-73b5-4dda-ad21-63bf08db617e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.010740] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.010740] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.010740] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.010740] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.010740] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.010740] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60943622-73b5-4dda-ad21-63bf08db617e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.011200] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('60943622-73b5-4dda-ad21-63bf08db617e',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.052284] env[67094]: INFO networking_nsxv3.common.synchronization [None req-d413b5aa-e62b-4734-8b28-e6bb0b003b92 None None] Enqueued Resource ID: fde3ec8d-d74a-4bad-840a-432cfc86e035 with Priority: HIGHEST for action port [ 662.052796] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fde3ec8d-d74a-4bad-840a-432cfc86e035 with Priority: HIGHEST for action port [ 662.053119] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-fde3ec8d-d74a-4bad-840a-432cfc86e035 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.053244] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fde3ec8d-d74a-4bad-840a-432cfc86e035" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.053309] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fde3ec8d-d74a-4bad-840a-432cfc86e035" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.053571] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fde3ec8d-d74a-4bad-840a-432cfc86e035" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.053645] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fde3ec8d-d74a-4bad-840a-432cfc86e035',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.185373] env[67094]: INFO networking_nsxv3.common.synchronization [None req-5ca8dc3b-2855-49ec-b36b-2e62874c457a None None] Enqueued Resource ID: 31aa87eb-edfb-4dee-81df-57fa7f258ab5 with Priority: HIGHEST for action port [ 662.185907] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31aa87eb-edfb-4dee-81df-57fa7f258ab5 with Priority: HIGHEST for action port [ 662.186810] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-31aa87eb-edfb-4dee-81df-57fa7f258ab5 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.187436] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31aa87eb-edfb-4dee-81df-57fa7f258ab5" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.187928] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31aa87eb-edfb-4dee-81df-57fa7f258ab5" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.188826] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31aa87eb-edfb-4dee-81df-57fa7f258ab5" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.188940] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31aa87eb-edfb-4dee-81df-57fa7f258ab5',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.268822] env[67094]: INFO networking_nsxv3.common.synchronization [req-17cbc7bf-0662-4b0c-a396-22c21d735668 req-64e173d3-e9c5-4d19-ae66-20acbb2c3c91 service nova] Enqueued Resource ID: 0ee9080c-8cce-48e3-86d7-285fa4431dd0 with Priority: HIGHEST for action security_group_rules [ 662.269279] env[67094]: INFO networking_nsxv3.common.synchronization [req-17cbc7bf-0662-4b0c-a396-22c21d735668 req-64e173d3-e9c5-4d19-ae66-20acbb2c3c91 service nova] Enqueued Resource ID: 0ee9080c-8cce-48e3-86d7-285fa4431dd0 with Priority: HIGHEST for action security_group_members [ 662.269279] env[67094]: INFO networking_nsxv3.common.synchronization [req-17cbc7bf-0662-4b0c-a396-22c21d735668 req-64e173d3-e9c5-4d19-ae66-20acbb2c3c91 service nova] Enqueued Resource ID: df2e1495-68af-45a6-9f83-1cd83a645036 with Priority: HIGHEST for action port [ 662.269792] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ee9080c-8cce-48e3-86d7-285fa4431dd0 with Priority: HIGHEST for action security_group_rules [ 662.269946] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ee9080c-8cce-48e3-86d7-285fa4431dd0 with Priority: HIGHEST for action security_group_members [ 662.270149] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df2e1495-68af-45a6-9f83-1cd83a645036 with Priority: HIGHEST for action port [ 662.270428] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ee9080c-8cce-48e3-86d7-285fa4431dd0 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.270563] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.270639] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.270857] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.270946] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ee9080c-8cce-48e3-86d7-285fa4431dd0',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.272306] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ee9080c-8cce-48e3-86d7-285fa4431dd0 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.272430] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.272655] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-df2e1495-68af-45a6-9f83-1cd83a645036 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.272787] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df2e1495-68af-45a6-9f83-1cd83a645036" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.272857] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df2e1495-68af-45a6-9f83-1cd83a645036" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.273057] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df2e1495-68af-45a6-9f83-1cd83a645036" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.273143] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df2e1495-68af-45a6-9f83-1cd83a645036',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.514641] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('60943622-73b5-4dda-ad21-63bf08db617e',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 662.558430] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fde3ec8d-d74a-4bad-840a-432cfc86e035 [ 662.558662] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.558794] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.558858] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.559082] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.559167] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.559256] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fde3ec8d-d74a-4bad-840a-432cfc86e035 already deleted. [ 662.559565] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fde3ec8d-d74a-4bad-840a-432cfc86e035" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.690828] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 31aa87eb-edfb-4dee-81df-57fa7f258ab5 [ 662.690828] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.690990] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.691321] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.691560] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.691652] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.691753] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:31aa87eb-edfb-4dee-81df-57fa7f258ab5 already deleted. [ 662.691835] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31aa87eb-edfb-4dee-81df-57fa7f258ab5" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.871652] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ee9080c-8cce-48e3-86d7-285fa4431dd0 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.871652] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.871652] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port df2e1495-68af-45a6-9f83-1cd83a645036 with status ACTIVE [ 662.871652] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.871652] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.871652] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.871652] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.871652] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.871652] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.871652] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.871652] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.871652] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.871652] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.871652] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.875687] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.875687] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.875687] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.875687] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.875687] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: df2e1495-68af-45a6-9f83-1cd83a645036 is going to be updated. [ 662.875687] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 662.875687] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 662.875687] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 662.875687] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 662.875687] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 662.875687] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df2e1495-68af-45a6-9f83-1cd83a645036" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.018369] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 60943622-73b5-4dda-ad21-63bf08db617e: rpc.has_security_group_logging(os_id): False [ 663.044812] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.044812] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.044812] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.045595] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.045595] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.046717] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.046717] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.046717] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.049262] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.049262] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.049262] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 60943622-73b5-4dda-ad21-63bf08db617e is going to be created. [ 663.119971] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.119971] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.119971] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.119971] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.119971] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.133680] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 60943622-73b5-4dda-ad21-63bf08db617e in Status: IN_PROGRESS for 2s [ 663.995193] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ee9080c-8cce-48e3-86d7-285fa4431dd0 in Status: SUCCESS [ 663.995193] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.995193] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.995193] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.995193] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 663.995193] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 663.995193] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 663.995193] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 663.995193] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 663.995193] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ee9080c-8cce-48e3-86d7-285fa4431dd0',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 664.498014] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0ee9080c-8cce-48e3-86d7-285fa4431dd0',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.004985] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0ee9080c-8cce-48e3-86d7-285fa4431dd0',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.058970] env[67094]: INFO networking_nsxv3.common.synchronization [None req-90374ddd-4f87-41b7-bf69-f0514cfe4611 None None] Enqueued Resource ID: 31a87e69-6678-41a3-8540-49f008c5142d with Priority: HIGHEST for action port [ 665.059913] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31a87e69-6678-41a3-8540-49f008c5142d with Priority: HIGHEST for action port [ 665.060285] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-31a87e69-6678-41a3-8540-49f008c5142d taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.060430] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31a87e69-6678-41a3-8540-49f008c5142d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.060497] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31a87e69-6678-41a3-8540-49f008c5142d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.060759] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31a87e69-6678-41a3-8540-49f008c5142d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.060889] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31a87e69-6678-41a3-8540-49f008c5142d',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 665.148297] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 60943622-73b5-4dda-ad21-63bf08db617e in Status: SUCCESS [ 665.148603] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-60943622-73b5-4dda-ad21-63bf08db617e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.508979] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.511455] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.511455] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.511455] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.511455] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.511669] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ee9080c-8cce-48e3-86d7-285fa4431dd0 is going to be updated. [ 665.546084] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.546268] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.546342] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.546562] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.546708] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.556151] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ee9080c-8cce-48e3-86d7-285fa4431dd0 in Status: IN_PROGRESS for 2s [ 665.563620] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 31a87e69-6678-41a3-8540-49f008c5142d [ 665.563843] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 665.563974] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 665.564145] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 665.564282] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 665.564372] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 665.564466] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:31a87e69-6678-41a3-8540-49f008c5142d already deleted. [ 665.564547] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31a87e69-6678-41a3-8540-49f008c5142d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.283622] env[67094]: INFO networking_nsxv3.common.synchronization [None req-1a73ee56-7f57-48b6-b75b-254183c1f560 None None] Enqueued Resource ID: 32217ea8-3f8a-49c1-b9f0-461e62b1f9fc with Priority: HIGHEST for action port [ 667.286602] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 32217ea8-3f8a-49c1-b9f0-461e62b1f9fc with Priority: HIGHEST for action port [ 667.286602] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-32217ea8-3f8a-49c1-b9f0-461e62b1f9fc taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.286602] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-32217ea8-3f8a-49c1-b9f0-461e62b1f9fc" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.286602] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-32217ea8-3f8a-49c1-b9f0-461e62b1f9fc" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.286602] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-32217ea8-3f8a-49c1-b9f0-461e62b1f9fc" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.286602] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('32217ea8-3f8a-49c1-b9f0-461e62b1f9fc',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.537509] env[67094]: INFO networking_nsxv3.common.synchronization [None req-0b02df38-adcd-4056-a752-f54365a15c88 None None] Enqueued Resource ID: 2f54be9d-cbd6-4371-8301-aa67cafb9b09 with Priority: HIGHEST for action port [ 667.538164] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2f54be9d-cbd6-4371-8301-aa67cafb9b09 with Priority: HIGHEST for action port [ 667.539484] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-2f54be9d-cbd6-4371-8301-aa67cafb9b09 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.539724] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2f54be9d-cbd6-4371-8301-aa67cafb9b09" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.539898] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2f54be9d-cbd6-4371-8301-aa67cafb9b09" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.540484] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2f54be9d-cbd6-4371-8301-aa67cafb9b09" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.541243] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2f54be9d-cbd6-4371-8301-aa67cafb9b09',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.571354] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ee9080c-8cce-48e3-86d7-285fa4431dd0 in Status: SUCCESS [ 667.571677] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.572545] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.572773] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.573010] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.573116] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.573238] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.573377] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.573516] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.573602] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.574706] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0ee9080c-8cce-48e3-86d7-285fa4431dd0',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 667.791703] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 32217ea8-3f8a-49c1-b9f0-461e62b1f9fc [ 667.793090] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.793090] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.793090] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.793090] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.793090] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.793090] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:32217ea8-3f8a-49c1-b9f0-461e62b1f9fc already deleted. [ 667.793090] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-32217ea8-3f8a-49c1-b9f0-461e62b1f9fc" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.853254] env[67094]: INFO networking_nsxv3.common.synchronization [req-4f4e15ff-902f-4aac-886c-f624157fd1ab req-2d9db216-96e7-43d2-9a89-18fb4e868377 tempest-ListServersNegativeTestJSON-1929385440 tempest-ListServersNegativeTestJSON-1929385440-project-member] Enqueued Resource ID: 90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 with Priority: HIGHEST for action security_group_members [ 667.853814] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 with Priority: HIGHEST for action security_group_members [ 667.854182] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.854322] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.854388] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.854709] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.854792] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 667.854933] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 667.854933] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 667.855094] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 667.855168] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 667.855276] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.047549] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2f54be9d-cbd6-4371-8301-aa67cafb9b09 [ 668.048399] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.048399] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.048399] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.048399] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.048399] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.048767] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2f54be9d-cbd6-4371-8301-aa67cafb9b09 already deleted. [ 668.048767] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2f54be9d-cbd6-4371-8301-aa67cafb9b09" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.080027] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ee9080c-8cce-48e3-86d7-285fa4431dd0 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.080276] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.080276] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.080769] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.080769] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.080769] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.080996] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.080996] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.081120] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.081171] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.081339] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ee9080c-8cce-48e3-86d7-285fa4431dd0 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.081495] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.081554] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.081663] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.081809] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.081903] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.081966] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.082222] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.082308] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.082396] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.082489] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0ee9080c-8cce-48e3-86d7-285fa4431dd0',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.360939] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 668.585165] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0ee9080c-8cce-48e3-86d7-285fa4431dd0: rpc.has_security_group_logging(os_id): False [ 668.612259] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.613314] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.613314] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.614188] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.614188] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.614188] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.614188] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.614188] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.614499] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.614646] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.614921] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.615100] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.615209] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.615425] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.616216] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.616915] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.617156] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.617280] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.621020] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.621020] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.621020] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ee9080c-8cce-48e3-86d7-285fa4431dd0 is going to be updated. [ 668.705373] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 668.705373] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 668.705373] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 668.705373] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 668.705373] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 668.726948] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0ee9080c-8cce-48e3-86d7-285fa4431dd0 in Status: IN_PROGRESS for 2s [ 668.868511] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.126195] env[67094]: INFO networking_nsxv3.common.synchronization [req-fe7db93b-888c-4515-8738-eb23e4ef0f9a req-36fd6eca-cf7f-40b5-9d08-a3f69c699e80 tempest-ServersAdminNegativeTestJSON-87945101 tempest-ServersAdminNegativeTestJSON-87945101-project-member] Enqueued Resource ID: 75d792df-97d6-4e1a-bf50-631a4a868869 with Priority: HIGHEST for action security_group_members [ 669.126613] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75d792df-97d6-4e1a-bf50-631a4a868869 with Priority: HIGHEST for action security_group_members [ 669.126956] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-75d792df-97d6-4e1a-bf50-631a4a868869 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.127648] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75d792df-97d6-4e1a-bf50-631a4a868869" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.127748] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75d792df-97d6-4e1a-bf50-631a4a868869" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.128007] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75d792df-97d6-4e1a-bf50-631a4a868869" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.128230] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.128378] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.128657] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.128835] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.128950] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.129092] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75d792df-97d6-4e1a-bf50-631a4a868869',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.372868] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.373391] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.373391] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.373391] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.373560] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.373609] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 is going to be updated. [ 669.413037] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.413037] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.413037] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.413415] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.413415] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.442287] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 in Status: IN_PROGRESS for 2s [ 669.558013] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock network-653 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.558654] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "network-653" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.558654] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "network-653" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.561295] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "network-653" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.561295] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.561295] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.561295] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.561295] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.561295] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.561653] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 669.561792] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 669.561919] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 669.562057] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 669.562191] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 669.562316] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 669.562473] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 669.585737] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 669.586043] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 669.586173] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 669.586398] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "network-653" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 669.586687] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock port-99246e7f-35c0-42da-87a9-b10cfe7549c4 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.586858] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "port-99246e7f-35c0-42da-87a9-b10cfe7549c4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.586971] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "port-99246e7f-35c0-42da-87a9-b10cfe7549c4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.587402] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "port-99246e7f-35c0-42da-87a9-b10cfe7549c4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.587546] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99246e7f-35c0-42da-87a9-b10cfe7549c4',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.631310] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('75d792df-97d6-4e1a-bf50-631a4a868869',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 669.869760] env[67094]: INFO networking_nsxv3.common.synchronization [None req-e08ea420-9ce3-41e6-969f-aef174394299 None None] Enqueued Resource ID: 399f699f-21f7-49fa-a86c-da1e7108931d with Priority: HIGHEST for action port [ 669.870333] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 399f699f-21f7-49fa-a86c-da1e7108931d with Priority: HIGHEST for action port [ 669.870649] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-399f699f-21f7-49fa-a86c-da1e7108931d taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 669.870785] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-399f699f-21f7-49fa-a86c-da1e7108931d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 669.870861] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-399f699f-21f7-49fa-a86c-da1e7108931d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 669.871814] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-399f699f-21f7-49fa-a86c-da1e7108931d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 669.871814] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('399f699f-21f7-49fa-a86c-da1e7108931d',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.091558] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.091901] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.092099] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.092529] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.092750] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.093023] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Segment Port 99246e7f-35c0-42da-87a9-b10cfe7549c4 not found, creating... [ 670.093441] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.093720] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.093913] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.094334] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.094567] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.095122] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.095390] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.095592] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.095881] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.096138] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.096351] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Resource: SegmentPort with ID: 99246e7f-35c0-42da-87a9-b10cfe7549c4 is going to be created. [ 670.134335] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('75d792df-97d6-4e1a-bf50-631a4a868869',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.142235] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.142528] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.142528] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.142913] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.143107] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.143321] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "port-99246e7f-35c0-42da-87a9-b10cfe7549c4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.165682] env[67094]: INFO networking_nsxv3.common.synchronization [None req-d6c7cb57-bbf9-49df-a15e-9b8f95c95a46 None None] Enqueued Resource ID: ce3cb8ed-859a-4ce4-9b04-c6d25d264098 with Priority: HIGHEST for action port [ 670.166796] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce3cb8ed-859a-4ce4-9b04-c6d25d264098 with Priority: HIGHEST for action port [ 670.167384] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-ce3cb8ed-859a-4ce4-9b04-c6d25d264098 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.167548] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ce3cb8ed-859a-4ce4-9b04-c6d25d264098" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.167717] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ce3cb8ed-859a-4ce4-9b04-c6d25d264098" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.168094] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ce3cb8ed-859a-4ce4-9b04-c6d25d264098" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.168260] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce3cb8ed-859a-4ce4-9b04-c6d25d264098',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.373177] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 399f699f-21f7-49fa-a86c-da1e7108931d [ 670.373566] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.373722] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.373808] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.374026] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.374115] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.374215] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:399f699f-21f7-49fa-a86c-da1e7108931d already deleted. [ 670.374299] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-399f699f-21f7-49fa-a86c-da1e7108931d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.638016] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.638231] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.638287] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.638461] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.638548] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.638647] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75d792df-97d6-4e1a-bf50-631a4a868869 is going to be updated. [ 670.672419] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.672634] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.672694] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.672855] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.673015] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.674237] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ce3cb8ed-859a-4ce4-9b04-c6d25d264098 [ 670.674456] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.674608] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.674698] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.674884] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.674967] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.675069] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ce3cb8ed-859a-4ce4-9b04-c6d25d264098 already deleted. [ 670.675149] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ce3cb8ed-859a-4ce4-9b04-c6d25d264098" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.683892] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75d792df-97d6-4e1a-bf50-631a4a868869 in Status: IN_PROGRESS for 2s [ 670.744839] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0ee9080c-8cce-48e3-86d7-285fa4431dd0 in Status: SUCCESS [ 670.744839] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 670.893438] env[67094]: INFO networking_nsxv3.common.synchronization [req-fe7db93b-888c-4515-8738-eb23e4ef0f9a req-74005439-6a6e-4127-8059-7ace190c5768 service nova] Enqueued Resource ID: 75d792df-97d6-4e1a-bf50-631a4a868869 with Priority: HIGHEST for action security_group_rules [ 670.893438] env[67094]: INFO networking_nsxv3.common.synchronization [req-fe7db93b-888c-4515-8738-eb23e4ef0f9a req-74005439-6a6e-4127-8059-7ace190c5768 service nova] Enqueued Resource ID: 75d792df-97d6-4e1a-bf50-631a4a868869 with Priority: HIGHEST for action security_group_members [ 670.893438] env[67094]: INFO networking_nsxv3.common.synchronization [req-fe7db93b-888c-4515-8738-eb23e4ef0f9a req-74005439-6a6e-4127-8059-7ace190c5768 service nova] Enqueued Resource ID: 99246e7f-35c0-42da-87a9-b10cfe7549c4 with Priority: HIGHEST for action port [ 670.893438] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75d792df-97d6-4e1a-bf50-631a4a868869 with Priority: HIGHEST for action security_group_rules [ 670.893438] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75d792df-97d6-4e1a-bf50-631a4a868869 with Priority: HIGHEST for action security_group_members [ 670.893635] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 99246e7f-35c0-42da-87a9-b10cfe7549c4 with Priority: HIGHEST for action port [ 670.893808] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-75d792df-97d6-4e1a-bf50-631a4a868869 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.893900] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-75d792df-97d6-4e1a-bf50-631a4a868869" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.893982] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-75d792df-97d6-4e1a-bf50-631a4a868869" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.894987] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-75d792df-97d6-4e1a-bf50-631a4a868869" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.894987] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('75d792df-97d6-4e1a-bf50-631a4a868869',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 670.896098] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-75d792df-97d6-4e1a-bf50-631a4a868869 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.896098] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75d792df-97d6-4e1a-bf50-631a4a868869" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.896556] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-99246e7f-35c0-42da-87a9-b10cfe7549c4 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 670.897113] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-99246e7f-35c0-42da-87a9-b10cfe7549c4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 670.897113] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-99246e7f-35c0-42da-87a9-b10cfe7549c4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 670.897113] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-99246e7f-35c0-42da-87a9-b10cfe7549c4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 670.897113] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('99246e7f-35c0-42da-87a9-b10cfe7549c4',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.399880] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-75d792df-97d6-4e1a-bf50-631a4a868869 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.400905] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75d792df-97d6-4e1a-bf50-631a4a868869" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.401448] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 99246e7f-35c0-42da-87a9-b10cfe7549c4 with status ACTIVE [ 671.401549] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.402184] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.402306] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.402495] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.402588] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.402778] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.403187] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.403187] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.403187] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.403187] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.403353] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.403456] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.403499] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.403654] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.403697] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.403756] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 99246e7f-35c0-42da-87a9-b10cfe7549c4 is going to be updated. [ 671.435322] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.435628] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.435720] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.435945] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.436114] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.436829] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-99246e7f-35c0-42da-87a9-b10cfe7549c4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.458136] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 in Status: SUCCESS [ 671.458343] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.896324] env[67094]: INFO networking_nsxv3.common.synchronization [req-508a5d22-d128-4e1f-add8-57c3f75ee233 req-96ac2663-fa1b-4516-9da8-e1521c3cb9e4 tempest-ServerDiagnosticsNegativeTest-1923608985 tempest-ServerDiagnosticsNegativeTest-1923608985-project-member] Enqueued Resource ID: f25d6704-85d6-488c-940d-05693a505db9 with Priority: HIGHEST for action security_group_members [ 671.896715] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f25d6704-85d6-488c-940d-05693a505db9 with Priority: HIGHEST for action security_group_members [ 671.901089] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-f25d6704-85d6-488c-940d-05693a505db9 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.901294] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f25d6704-85d6-488c-940d-05693a505db9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.901360] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f25d6704-85d6-488c-940d-05693a505db9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.901600] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f25d6704-85d6-488c-940d-05693a505db9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.901818] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.901902] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.901945] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.903088] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.903088] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 671.903088] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f25d6704-85d6-488c-940d-05693a505db9',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 671.988361] env[67094]: INFO networking_nsxv3.common.synchronization [None req-19a0df1b-ac55-4c79-81c6-be93aa0d7fd5 None None] Enqueued Resource ID: 435d5e7b-6b8e-4098-ab1b-7414f175ac30 with Priority: HIGHEST for action port [ 671.989314] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 435d5e7b-6b8e-4098-ab1b-7414f175ac30 with Priority: HIGHEST for action port [ 671.989686] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-435d5e7b-6b8e-4098-ab1b-7414f175ac30 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 671.990392] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-435d5e7b-6b8e-4098-ab1b-7414f175ac30" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 671.990469] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-435d5e7b-6b8e-4098-ab1b-7414f175ac30" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 671.990867] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-435d5e7b-6b8e-4098-ab1b-7414f175ac30" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 671.990959] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('435d5e7b-6b8e-4098-ab1b-7414f175ac30',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 672.408177] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.409466] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.409466] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.409466] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.409466] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.409466] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.409466] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.409466] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.409904] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.412131] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.412244] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f25d6704-85d6-488c-940d-05693a505db9 is going to be updated. [ 672.458701] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.459030] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.459030] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.459183] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.459301] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.471836] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f25d6704-85d6-488c-940d-05693a505db9 in Status: IN_PROGRESS for 2s [ 672.493796] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 435d5e7b-6b8e-4098-ab1b-7414f175ac30 [ 672.494275] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.494655] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.494734] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.495497] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.495972] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.496106] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:435d5e7b-6b8e-4098-ab1b-7414f175ac30 already deleted. [ 672.496193] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-435d5e7b-6b8e-4098-ab1b-7414f175ac30" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.696090] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75d792df-97d6-4e1a-bf50-631a4a868869 in Status: SUCCESS [ 672.696327] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75d792df-97d6-4e1a-bf50-631a4a868869" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.697872] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75d792df-97d6-4e1a-bf50-631a4a868869" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.697872] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75d792df-97d6-4e1a-bf50-631a4a868869" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.697872] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 672.697872] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 672.697872] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 672.697872] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 672.697872] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 672.697872] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75d792df-97d6-4e1a-bf50-631a4a868869',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.202120] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('75d792df-97d6-4e1a-bf50-631a4a868869',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.706418] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('75d792df-97d6-4e1a-bf50-631a4a868869',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 673.808684] env[67094]: INFO networking_nsxv3.common.synchronization [None req-802642ff-d422-491b-94b1-910d414153bc tempest-ServersTestManualDisk-1900155527 tempest-ServersTestManualDisk-1900155527-project-member] Enqueued Resource ID: 6b8aa78a-ad3e-4d9d-94d1-2156bff23176 with Priority: HIGHEST for action security_group_rules [ 673.808979] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b8aa78a-ad3e-4d9d-94d1-2156bff23176 with Priority: HIGHEST for action security_group_rules [ 673.809404] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b8aa78a-ad3e-4d9d-94d1-2156bff23176 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 673.809533] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b8aa78a-ad3e-4d9d-94d1-2156bff23176" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 673.809595] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b8aa78a-ad3e-4d9d-94d1-2156bff23176" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 673.809892] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b8aa78a-ad3e-4d9d-94d1-2156bff23176" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 673.810095] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b8aa78a-ad3e-4d9d-94d1-2156bff23176',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.209219] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.209436] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.209517] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.209763] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.210119] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.210119] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75d792df-97d6-4e1a-bf50-631a4a868869 is going to be updated. [ 674.245943] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.246164] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.246280] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.246452] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.248551] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.259244] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75d792df-97d6-4e1a-bf50-631a4a868869 in Status: IN_PROGRESS for 2s [ 674.335509] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.335665] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.335734] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.335943] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.336043] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.336140] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b8aa78a-ad3e-4d9d-94d1-2156bff23176 already deleted. [ 674.336224] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b8aa78a-ad3e-4d9d-94d1-2156bff23176" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.345018] env[67094]: INFO networking_nsxv3.common.synchronization [None req-4989817f-99e5-493b-91a0-2723b194a7f8 tempest-ServersTestManualDisk-1900155527 tempest-ServersTestManualDisk-1900155527-project-member] Enqueued Resource ID: 6b8aa78a-ad3e-4d9d-94d1-2156bff23176 with Priority: HIGHEST for action security_group_rules [ 674.345596] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b8aa78a-ad3e-4d9d-94d1-2156bff23176 with Priority: HIGHEST for action security_group_rules [ 674.345889] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b8aa78a-ad3e-4d9d-94d1-2156bff23176 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.346085] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b8aa78a-ad3e-4d9d-94d1-2156bff23176" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.346085] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b8aa78a-ad3e-4d9d-94d1-2156bff23176" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.347059] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b8aa78a-ad3e-4d9d-94d1-2156bff23176" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.347059] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b8aa78a-ad3e-4d9d-94d1-2156bff23176',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.483887] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f25d6704-85d6-488c-940d-05693a505db9 in Status: SUCCESS [ 674.484131] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f25d6704-85d6-488c-940d-05693a505db9 deletion is rescheduled due to dependency. [ 674.484271] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f25d6704-85d6-488c-940d-05693a505db9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.723679] env[67094]: INFO networking_nsxv3.common.synchronization [None req-38f91036-816f-4ffc-a4ae-bfabd0296674 None None] Enqueued Resource ID: 4652f99b-bbed-4e73-a30c-a0be82ff4007 with Priority: HIGHEST for action port [ 674.727638] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4652f99b-bbed-4e73-a30c-a0be82ff4007 with Priority: HIGHEST for action port [ 674.728061] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-4652f99b-bbed-4e73-a30c-a0be82ff4007 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.728563] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4652f99b-bbed-4e73-a30c-a0be82ff4007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.728646] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4652f99b-bbed-4e73-a30c-a0be82ff4007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.728991] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4652f99b-bbed-4e73-a30c-a0be82ff4007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.728991] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4652f99b-bbed-4e73-a30c-a0be82ff4007',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 674.874711] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 674.874711] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 674.874711] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 674.874711] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 674.874711] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 674.874711] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b8aa78a-ad3e-4d9d-94d1-2156bff23176 already deleted. [ 674.874711] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b8aa78a-ad3e-4d9d-94d1-2156bff23176" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.233279] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4652f99b-bbed-4e73-a30c-a0be82ff4007 [ 675.233279] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.233279] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.233279] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.233279] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.233279] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.233279] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4652f99b-bbed-4e73-a30c-a0be82ff4007 already deleted. [ 675.233279] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4652f99b-bbed-4e73-a30c-a0be82ff4007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.306265] env[67094]: INFO networking_nsxv3.common.synchronization [None req-352f9c2d-ec12-434e-9b07-4eaa628d4f10 None None] Enqueued Resource ID: 6d121dc0-cbe6-4c7c-933e-9f1016da6892 with Priority: HIGHEST for action port [ 675.307496] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6d121dc0-cbe6-4c7c-933e-9f1016da6892 with Priority: HIGHEST for action port [ 675.308385] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-6d121dc0-cbe6-4c7c-933e-9f1016da6892 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.309897] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6d121dc0-cbe6-4c7c-933e-9f1016da6892" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.309897] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6d121dc0-cbe6-4c7c-933e-9f1016da6892" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.309897] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6d121dc0-cbe6-4c7c-933e-9f1016da6892" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.309897] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6d121dc0-cbe6-4c7c-933e-9f1016da6892',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.498877] env[67094]: INFO networking_nsxv3.common.synchronization [req-d638d22a-bf96-4cd9-b3c2-68aeb9c07f27 req-04cbd914-2fea-4091-b1be-3d059d74e387 tempest-DeleteServersAdminTestJSON-1006034417 tempest-DeleteServersAdminTestJSON-1006034417-project-member] Enqueued Resource ID: 34103f55-eb7e-4602-9672-09596df7eaa4 with Priority: HIGHEST for action security_group_members [ 675.499493] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34103f55-eb7e-4602-9672-09596df7eaa4 with Priority: HIGHEST for action security_group_members [ 675.502076] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-34103f55-eb7e-4602-9672-09596df7eaa4 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.502076] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34103f55-eb7e-4602-9672-09596df7eaa4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.502076] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34103f55-eb7e-4602-9672-09596df7eaa4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.502076] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34103f55-eb7e-4602-9672-09596df7eaa4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.502076] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.502076] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.502076] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.502076] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.502076] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.502076] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34103f55-eb7e-4602-9672-09596df7eaa4',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 675.814258] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6d121dc0-cbe6-4c7c-933e-9f1016da6892 [ 675.815389] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 675.815603] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 675.815746] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 675.816118] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 675.816194] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 675.816275] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6d121dc0-cbe6-4c7c-933e-9f1016da6892 already deleted. [ 675.816421] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6d121dc0-cbe6-4c7c-933e-9f1016da6892" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.005917] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.005917] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.005917] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.006232] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.006232] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.006511] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.006625] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.006766] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.006856] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.006905] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.006997] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34103f55-eb7e-4602-9672-09596df7eaa4 is going to be updated. [ 676.042323] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.042499] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.042566] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.042757] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.042891] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.056491] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34103f55-eb7e-4602-9672-09596df7eaa4 in Status: IN_PROGRESS for 2s [ 676.273019] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75d792df-97d6-4e1a-bf50-631a4a868869 in Status: SUCCESS [ 676.273530] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75d792df-97d6-4e1a-bf50-631a4a868869" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.273530] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75d792df-97d6-4e1a-bf50-631a4a868869" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.273692] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75d792df-97d6-4e1a-bf50-631a4a868869" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.273832] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.273998] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.273998] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.274210] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.274270] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.274336] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75d792df-97d6-4e1a-bf50-631a4a868869" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.274433] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('75d792df-97d6-4e1a-bf50-631a4a868869',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.280584] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock network-653 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.280584] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "network-653" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.280584] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "network-653" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.280584] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "network-653" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.280584] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.280584] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.280584] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.280584] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.280584] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.280584] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 676.280584] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 676.280584] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 676.280584] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 676.281700] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 676.281700] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 676.281700] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 676.297282] env[67094]: INFO networking_nsxv3.common.synchronization [req-a50ffac2-5fe4-4534-a986-0141ba1369f8 req-cf826588-6eb8-4f81-8cac-a37a86a26ff9 tempest-ImagesTestJSON-2097058733 tempest-ImagesTestJSON-2097058733-project-member] Enqueued Resource ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa with Priority: HIGHEST for action security_group_members [ 676.297624] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa with Priority: HIGHEST for action security_group_members [ 676.298702] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-84918628-8f8e-4d25-9c0f-17cccb58ebfa taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.299034] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.299410] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.301030] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.301030] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.301030] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.301030] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.301030] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.301030] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.301030] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('84918628-8f8e-4d25-9c0f-17cccb58ebfa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.309546] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 676.309870] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 676.310040] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 676.310219] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "network-653" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.311279] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock port-e54ddfbd-1bdd-4f19-bcab-5a3ef5c39c64 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.311476] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "port-e54ddfbd-1bdd-4f19-bcab-5a3ef5c39c64" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.311598] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "port-e54ddfbd-1bdd-4f19-bcab-5a3ef5c39c64" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.311941] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "port-e54ddfbd-1bdd-4f19-bcab-5a3ef5c39c64" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.312081] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e54ddfbd-1bdd-4f19-bcab-5a3ef5c39c64',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.782037] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-75d792df-97d6-4e1a-bf50-631a4a868869 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.782227] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75d792df-97d6-4e1a-bf50-631a4a868869" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.782227] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75d792df-97d6-4e1a-bf50-631a4a868869" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.782527] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75d792df-97d6-4e1a-bf50-631a4a868869" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.782755] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.782903] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.782998] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.783199] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.783351] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.783481] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75d792df-97d6-4e1a-bf50-631a4a868869" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.783663] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-75d792df-97d6-4e1a-bf50-631a4a868869 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.783794] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75d792df-97d6-4e1a-bf50-631a4a868869" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.783888] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75d792df-97d6-4e1a-bf50-631a4a868869" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.784145] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75d792df-97d6-4e1a-bf50-631a4a868869" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.784348] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.784818] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.784818] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.784818] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.784818] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.784818] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75d792df-97d6-4e1a-bf50-631a4a868869" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.785054] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('75d792df-97d6-4e1a-bf50-631a4a868869',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 676.806071] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.806305] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.806386] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.807048] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.807048] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.807048] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.807048] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.807395] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.807395] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.807395] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.807577] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa is going to be updated. [ 676.817898] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.818361] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.818456] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.819753] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.819753] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.819753] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Segment Port e54ddfbd-1bdd-4f19-bcab-5a3ef5c39c64 not found, creating... [ 676.819753] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.819753] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.819753] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.820307] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.820307] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.821570] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.821570] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.821570] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.821570] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.821570] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.821570] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Resource: SegmentPort with ID: e54ddfbd-1bdd-4f19-bcab-5a3ef5c39c64 is going to be created. [ 676.851256] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.851515] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.851638] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.851939] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.852582] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.852748] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "port-e54ddfbd-1bdd-4f19-bcab-5a3ef5c39c64" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.854583] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 676.854759] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 676.854810] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 676.854969] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 676.855111] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 676.867029] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa in Status: IN_PROGRESS for 2s [ 677.246598] env[67094]: INFO networking_nsxv3.common.synchronization [None req-f36f2d09-0b57-4fc3-ba08-6c8983f82db5 None None] Enqueued Resource ID: df980750-67de-4c57-a8ad-2f632ef2d01d with Priority: HIGHEST for action port [ 677.247872] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: df980750-67de-4c57-a8ad-2f632ef2d01d with Priority: HIGHEST for action port [ 677.248751] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-df980750-67de-4c57-a8ad-2f632ef2d01d taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.248751] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-df980750-67de-4c57-a8ad-2f632ef2d01d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.248751] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-df980750-67de-4c57-a8ad-2f632ef2d01d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.249341] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-df980750-67de-4c57-a8ad-2f632ef2d01d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.249341] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('df980750-67de-4c57-a8ad-2f632ef2d01d',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.286847] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 75d792df-97d6-4e1a-bf50-631a4a868869: rpc.has_security_group_logging(os_id): False [ 677.314837] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.315291] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.315291] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.315477] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.315571] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.316098] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.316098] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.316098] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.316437] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.316437] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.316437] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.316651] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.316651] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.316728] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.317097] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.317097] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.317097] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.317612] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.317612] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.317612] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.317768] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 75d792df-97d6-4e1a-bf50-631a4a868869 is going to be updated. [ 677.415589] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.415827] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.417082] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.417082] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.417082] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.435506] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 75d792df-97d6-4e1a-bf50-631a4a868869 in Status: IN_PROGRESS for 2s [ 677.652086] env[67094]: INFO networking_nsxv3.common.synchronization [req-d638d22a-bf96-4cd9-b3c2-68aeb9c07f27 req-256af7f5-f336-40c4-8b3c-b6326d153135 service nova] Enqueued Resource ID: 34103f55-eb7e-4602-9672-09596df7eaa4 with Priority: HIGHEST for action security_group_rules [ 677.652086] env[67094]: INFO networking_nsxv3.common.synchronization [req-d638d22a-bf96-4cd9-b3c2-68aeb9c07f27 req-256af7f5-f336-40c4-8b3c-b6326d153135 service nova] Enqueued Resource ID: 34103f55-eb7e-4602-9672-09596df7eaa4 with Priority: HIGHEST for action security_group_members [ 677.652086] env[67094]: INFO networking_nsxv3.common.synchronization [req-d638d22a-bf96-4cd9-b3c2-68aeb9c07f27 req-256af7f5-f336-40c4-8b3c-b6326d153135 service nova] Enqueued Resource ID: e54ddfbd-1bdd-4f19-bcab-5a3ef5c39c64 with Priority: HIGHEST for action port [ 677.654968] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34103f55-eb7e-4602-9672-09596df7eaa4 with Priority: HIGHEST for action security_group_rules [ 677.655284] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34103f55-eb7e-4602-9672-09596df7eaa4 with Priority: HIGHEST for action security_group_members [ 677.656109] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e54ddfbd-1bdd-4f19-bcab-5a3ef5c39c64 with Priority: HIGHEST for action port [ 677.657267] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-34103f55-eb7e-4602-9672-09596df7eaa4 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.657463] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-34103f55-eb7e-4602-9672-09596df7eaa4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.658031] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-34103f55-eb7e-4602-9672-09596df7eaa4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.658031] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-34103f55-eb7e-4602-9672-09596df7eaa4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.658031] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('34103f55-eb7e-4602-9672-09596df7eaa4',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.659751] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-34103f55-eb7e-4602-9672-09596df7eaa4 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.659915] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34103f55-eb7e-4602-9672-09596df7eaa4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.660139] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-e54ddfbd-1bdd-4f19-bcab-5a3ef5c39c64 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.660300] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e54ddfbd-1bdd-4f19-bcab-5a3ef5c39c64" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.660374] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e54ddfbd-1bdd-4f19-bcab-5a3ef5c39c64" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.660582] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e54ddfbd-1bdd-4f19-bcab-5a3ef5c39c64" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.660665] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e54ddfbd-1bdd-4f19-bcab-5a3ef5c39c64',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 677.751983] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port df980750-67de-4c57-a8ad-2f632ef2d01d [ 677.752257] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 677.752404] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 677.752491] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 677.752735] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 677.752945] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 677.752945] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:df980750-67de-4c57-a8ad-2f632ef2d01d already deleted. [ 677.753077] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-df980750-67de-4c57-a8ad-2f632ef2d01d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.078910] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34103f55-eb7e-4602-9672-09596df7eaa4 in Status: SUCCESS [ 678.079299] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34103f55-eb7e-4602-9672-09596df7eaa4 deletion is rescheduled due to dependency. [ 678.079299] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34103f55-eb7e-4602-9672-09596df7eaa4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.079299] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34103f55-eb7e-4602-9672-09596df7eaa4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.079748] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34103f55-eb7e-4602-9672-09596df7eaa4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.079748] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.080012] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.080012] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.080194] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.080194] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.080260] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34103f55-eb7e-4602-9672-09596df7eaa4',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.163157] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-34103f55-eb7e-4602-9672-09596df7eaa4 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.163399] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34103f55-eb7e-4602-9672-09596df7eaa4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.164624] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e54ddfbd-1bdd-4f19-bcab-5a3ef5c39c64 with status ACTIVE [ 678.165466] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.165728] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.165817] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.166133] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.166279] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.166637] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.166767] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.166835] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.167062] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.167192] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.167456] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.167618] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.167728] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.167962] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.168052] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.168148] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e54ddfbd-1bdd-4f19-bcab-5a3ef5c39c64 is going to be updated. [ 678.193750] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.194155] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.194155] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.194371] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.194371] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.194519] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e54ddfbd-1bdd-4f19-bcab-5a3ef5c39c64" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.234068] env[67094]: INFO networking_nsxv3.common.synchronization [None req-b0f7fedd-e6d3-4c68-ae01-385b274d8704 None None] Enqueued Resource ID: 0040f8dd-0058-4eab-9ea4-7e2766d5f802 with Priority: HIGHEST for action port [ 678.234701] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0040f8dd-0058-4eab-9ea4-7e2766d5f802 with Priority: HIGHEST for action port [ 678.235231] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-0040f8dd-0058-4eab-9ea4-7e2766d5f802 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.236242] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0040f8dd-0058-4eab-9ea4-7e2766d5f802" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.236242] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0040f8dd-0058-4eab-9ea4-7e2766d5f802" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.236242] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0040f8dd-0058-4eab-9ea4-7e2766d5f802" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.236242] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0040f8dd-0058-4eab-9ea4-7e2766d5f802',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.582507] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('34103f55-eb7e-4602-9672-09596df7eaa4',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 678.739234] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0040f8dd-0058-4eab-9ea4-7e2766d5f802 [ 678.739468] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 678.739624] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 678.739695] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 678.739917] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 678.740032] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.740131] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0040f8dd-0058-4eab-9ea4-7e2766d5f802 already deleted. [ 678.740216] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0040f8dd-0058-4eab-9ea4-7e2766d5f802" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 678.879596] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa in Status: SUCCESS [ 678.879863] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa deletion is rescheduled due to dependency. [ 678.879987] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.087470] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('34103f55-eb7e-4602-9672-09596df7eaa4',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.294382] env[67094]: INFO networking_nsxv3.common.synchronization [req-2ea1d709-b617-4947-945a-49eb9c1fcb26 req-66455680-e6a8-43f3-9104-f0872b1e2403 tempest-ServerDiagnosticsTest-1342523960 tempest-ServerDiagnosticsTest-1342523960-project-member] Enqueued Resource ID: 52851555-797a-47ba-b408-d4557f3f4ec2 with Priority: HIGHEST for action security_group_members [ 679.294382] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52851555-797a-47ba-b408-d4557f3f4ec2 with Priority: HIGHEST for action security_group_members [ 679.294382] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-52851555-797a-47ba-b408-d4557f3f4ec2 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.295112] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52851555-797a-47ba-b408-d4557f3f4ec2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.295195] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52851555-797a-47ba-b408-d4557f3f4ec2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.295895] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52851555-797a-47ba-b408-d4557f3f4ec2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.296093] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.296294] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.296358] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.296544] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.296709] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.296830] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52851555-797a-47ba-b408-d4557f3f4ec2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.452243] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 75d792df-97d6-4e1a-bf50-631a4a868869 in Status: SUCCESS [ 679.452243] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-75d792df-97d6-4e1a-bf50-631a4a868869" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.592878] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.593069] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.593166] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.593400] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.593525] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.593610] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34103f55-eb7e-4602-9672-09596df7eaa4 is going to be updated. [ 679.624594] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.624747] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.624833] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.625090] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.625225] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.635092] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34103f55-eb7e-4602-9672-09596df7eaa4 in Status: IN_PROGRESS for 2s [ 679.656700] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock network-653 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.656899] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "network-653" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.657057] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "network-653" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.657436] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "network-653" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.657696] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.658221] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.658400] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.658634] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.658809] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.659096] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 679.659271] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 679.659442] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 679.659588] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 679.659703] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 679.659827] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 679.660042] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 679.682941] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 679.683119] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 679.683252] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 679.683421] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "network-653" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.683782] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock port-e4368826-0e1a-42bb-8cde-84ef967808db taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.683909] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "port-e4368826-0e1a-42bb-8cde-84ef967808db" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.684022] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "port-e4368826-0e1a-42bb-8cde-84ef967808db" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.684647] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "port-e4368826-0e1a-42bb-8cde-84ef967808db" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.684647] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e4368826-0e1a-42bb-8cde-84ef967808db',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 679.800245] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.802110] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.802110] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.802110] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.802110] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.802110] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 679.802110] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 679.802110] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 679.802110] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 679.802110] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 679.802110] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52851555-797a-47ba-b408-d4557f3f4ec2 already deleted. [ 679.802110] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52851555-797a-47ba-b408-d4557f3f4ec2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.189819] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.190247] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.190247] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.190554] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.191059] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.191332] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Segment Port e4368826-0e1a-42bb-8cde-84ef967808db not found, creating... [ 680.191739] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.191985] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.192233] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.192603] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.192798] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.193178] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.193400] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.193593] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.193935] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.194190] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.194394] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Resource: SegmentPort with ID: e4368826-0e1a-42bb-8cde-84ef967808db is going to be created. [ 680.215300] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.216294] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.216555] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.217285] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.217396] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.217709] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "port-e4368826-0e1a-42bb-8cde-84ef967808db" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.456395] env[67094]: INFO networking_nsxv3.common.synchronization [None req-92836e86-c549-46b4-a0bd-f8df1c84203e None None] Enqueued Resource ID: 2a33a2cb-52e9-419d-8117-82f46f7085cb with Priority: HIGHEST for action port [ 680.457512] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2a33a2cb-52e9-419d-8117-82f46f7085cb with Priority: HIGHEST for action port [ 680.458152] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-2a33a2cb-52e9-419d-8117-82f46f7085cb taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.458344] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2a33a2cb-52e9-419d-8117-82f46f7085cb" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.458469] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2a33a2cb-52e9-419d-8117-82f46f7085cb" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.458784] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2a33a2cb-52e9-419d-8117-82f46f7085cb" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.458900] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2a33a2cb-52e9-419d-8117-82f46f7085cb',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 680.963314] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2a33a2cb-52e9-419d-8117-82f46f7085cb [ 680.963641] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 680.963815] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 680.963912] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 680.964314] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 680.964759] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 680.964921] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2a33a2cb-52e9-419d-8117-82f46f7085cb already deleted. [ 680.964982] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2a33a2cb-52e9-419d-8117-82f46f7085cb" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.373708] env[67094]: INFO networking_nsxv3.common.synchronization [req-2ea1d709-b617-4947-945a-49eb9c1fcb26 req-bdfa6caa-8a48-4775-9502-2f74b43b4bb5 service nova] Enqueued Resource ID: 52851555-797a-47ba-b408-d4557f3f4ec2 with Priority: HIGHEST for action security_group_rules [ 681.373997] env[67094]: INFO networking_nsxv3.common.synchronization [req-2ea1d709-b617-4947-945a-49eb9c1fcb26 req-bdfa6caa-8a48-4775-9502-2f74b43b4bb5 service nova] Enqueued Resource ID: 52851555-797a-47ba-b408-d4557f3f4ec2 with Priority: HIGHEST for action security_group_members [ 681.374351] env[67094]: INFO networking_nsxv3.common.synchronization [req-2ea1d709-b617-4947-945a-49eb9c1fcb26 req-bdfa6caa-8a48-4775-9502-2f74b43b4bb5 service nova] Enqueued Resource ID: e4368826-0e1a-42bb-8cde-84ef967808db with Priority: HIGHEST for action port [ 681.375089] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52851555-797a-47ba-b408-d4557f3f4ec2 with Priority: HIGHEST for action security_group_rules [ 681.375132] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52851555-797a-47ba-b408-d4557f3f4ec2 with Priority: HIGHEST for action security_group_members [ 681.375294] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e4368826-0e1a-42bb-8cde-84ef967808db with Priority: HIGHEST for action port [ 681.375770] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-52851555-797a-47ba-b408-d4557f3f4ec2 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.375974] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-52851555-797a-47ba-b408-d4557f3f4ec2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.376134] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-52851555-797a-47ba-b408-d4557f3f4ec2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.376454] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-52851555-797a-47ba-b408-d4557f3f4ec2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.376604] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('52851555-797a-47ba-b408-d4557f3f4ec2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.380044] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-52851555-797a-47ba-b408-d4557f3f4ec2 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.380044] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52851555-797a-47ba-b408-d4557f3f4ec2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.380044] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52851555-797a-47ba-b408-d4557f3f4ec2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.380044] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52851555-797a-47ba-b408-d4557f3f4ec2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.380044] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.380044] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.380044] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.380044] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.380044] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.380044] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52851555-797a-47ba-b408-d4557f3f4ec2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.383355] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-e4368826-0e1a-42bb-8cde-84ef967808db taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.383355] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e4368826-0e1a-42bb-8cde-84ef967808db" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.383355] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e4368826-0e1a-42bb-8cde-84ef967808db" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.383355] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e4368826-0e1a-42bb-8cde-84ef967808db" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.383355] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e4368826-0e1a-42bb-8cde-84ef967808db',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.646909] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34103f55-eb7e-4602-9672-09596df7eaa4 in Status: SUCCESS [ 681.647105] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34103f55-eb7e-4602-9672-09596df7eaa4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.647326] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34103f55-eb7e-4602-9672-09596df7eaa4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.647493] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34103f55-eb7e-4602-9672-09596df7eaa4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.647704] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.647820] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.647903] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.648070] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.648218] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.648295] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34103f55-eb7e-4602-9672-09596df7eaa4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.648437] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('34103f55-eb7e-4602-9672-09596df7eaa4',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.867032] env[67094]: INFO networking_nsxv3.common.synchronization [req-c1a816d9-7c4b-4ae6-879a-6bba3bfa369f req-5a12e67f-86ae-4dcc-9dfe-0d6d5a5e891a tempest-AttachInterfacesUnderV243Test-1867486125 tempest-AttachInterfacesUnderV243Test-1867486125-project-member] Enqueued Resource ID: 00b541f3-9964-40ec-91e3-e2aa8166f007 with Priority: HIGHEST for action security_group_members [ 681.867626] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00b541f3-9964-40ec-91e3-e2aa8166f007 with Priority: HIGHEST for action security_group_members [ 681.867936] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-00b541f3-9964-40ec-91e3-e2aa8166f007 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.868068] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00b541f3-9964-40ec-91e3-e2aa8166f007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.868144] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00b541f3-9964-40ec-91e3-e2aa8166f007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.868408] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00b541f3-9964-40ec-91e3-e2aa8166f007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.868565] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.868688] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.868756] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.868958] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.869059] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.869161] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00b541f3-9964-40ec-91e3-e2aa8166f007',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.885077] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-52851555-797a-47ba-b408-d4557f3f4ec2 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.885228] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52851555-797a-47ba-b408-d4557f3f4ec2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.885648] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('52851555-797a-47ba-b408-d4557f3f4ec2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 681.886491] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e4368826-0e1a-42bb-8cde-84ef967808db with status ACTIVE [ 681.886694] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.886797] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.886862] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.887182] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.887182] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.887367] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.887461] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.887531] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.887689] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.887788] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.888122] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.888315] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.888557] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.888640] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.888777] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.888777] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e4368826-0e1a-42bb-8cde-84ef967808db is going to be updated. [ 681.916620] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 681.916620] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 681.916780] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 681.917360] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 681.917360] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 681.917360] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e4368826-0e1a-42bb-8cde-84ef967808db" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.153051] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-34103f55-eb7e-4602-9672-09596df7eaa4 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.153051] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34103f55-eb7e-4602-9672-09596df7eaa4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.153279] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34103f55-eb7e-4602-9672-09596df7eaa4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.153663] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34103f55-eb7e-4602-9672-09596df7eaa4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.153800] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.153954] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.154078] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.154274] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.154392] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.154503] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34103f55-eb7e-4602-9672-09596df7eaa4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.154678] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-34103f55-eb7e-4602-9672-09596df7eaa4 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.154832] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34103f55-eb7e-4602-9672-09596df7eaa4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.154914] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34103f55-eb7e-4602-9672-09596df7eaa4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.155255] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34103f55-eb7e-4602-9672-09596df7eaa4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.155470] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.155611] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.155696] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.155861] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.155963] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.156080] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34103f55-eb7e-4602-9672-09596df7eaa4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.156195] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('34103f55-eb7e-4602-9672-09596df7eaa4',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.284193] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock network-445 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.284349] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "network-445" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.285354] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "network-445" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.285354] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "network-445" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.285354] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.285354] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.285763] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.285763] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.285863] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.286068] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 682.286210] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 682.286341] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 682.286442] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 682.287286] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 682.287286] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 682.287286] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 682.310111] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 682.310284] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 682.310419] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 682.310586] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "network-445" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.310998] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock port-e38e7960-e93e-4cd0-a437-2d17f9d1a161 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.312167] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "port-e38e7960-e93e-4cd0-a437-2d17f9d1a161" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.312167] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "port-e38e7960-e93e-4cd0-a437-2d17f9d1a161" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.312167] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "port-e38e7960-e93e-4cd0-a437-2d17f9d1a161" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.312167] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e38e7960-e93e-4cd0-a437-2d17f9d1a161',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.371550] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.371714] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.371788] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.372014] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.372102] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.372306] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.372388] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.372523] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.372597] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.372673] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.373126] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00b541f3-9964-40ec-91e3-e2aa8166f007 already deleted. [ 682.373126] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00b541f3-9964-40ec-91e3-e2aa8166f007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.391218] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('52851555-797a-47ba-b408-d4557f3f4ec2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 682.658699] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 34103f55-eb7e-4602-9672-09596df7eaa4: rpc.has_security_group_logging(os_id): False [ 682.681441] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.681686] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.681745] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.681945] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.682145] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.682383] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.682491] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.682557] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.682723] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.682807] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.683015] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.683204] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.683282] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.683462] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.683577] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.683784] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.683937] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.684015] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.684169] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.684249] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.684338] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 34103f55-eb7e-4602-9672-09596df7eaa4 is going to be updated. [ 682.764958] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.765242] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.765242] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.765446] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.765600] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.778195] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34103f55-eb7e-4602-9672-09596df7eaa4 in Status: IN_PROGRESS for 2s [ 682.815759] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.816029] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.816138] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.816422] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.816570] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.816726] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Segment Port e38e7960-e93e-4cd0-a437-2d17f9d1a161 not found, creating... [ 682.816988] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.817212] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.817366] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.817574] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.817710] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.818011] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.818156] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.818302] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.818468] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.818607] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.818723] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Resource: SegmentPort with ID: e38e7960-e93e-4cd0-a437-2d17f9d1a161 is going to be created. [ 682.862519] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.862729] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.862847] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.863143] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.863375] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.863608] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "port-e38e7960-e93e-4cd0-a437-2d17f9d1a161" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.894079] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.894297] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.894297] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.894532] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.894610] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.894677] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52851555-797a-47ba-b408-d4557f3f4ec2 is going to be created. [ 682.948120] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 682.948971] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 682.948971] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 682.948971] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 682.948971] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 682.959984] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52851555-797a-47ba-b408-d4557f3f4ec2 in Status: UNINITIALIZED for 2s [ 683.861850] env[67094]: INFO networking_nsxv3.common.synchronization [req-c1a816d9-7c4b-4ae6-879a-6bba3bfa369f req-24c33e8d-e7ed-45e8-a834-5465fa6a3767 service nova] Enqueued Resource ID: 00b541f3-9964-40ec-91e3-e2aa8166f007 with Priority: HIGHEST for action security_group_rules [ 683.862202] env[67094]: INFO networking_nsxv3.common.synchronization [req-c1a816d9-7c4b-4ae6-879a-6bba3bfa369f req-24c33e8d-e7ed-45e8-a834-5465fa6a3767 service nova] Enqueued Resource ID: 00b541f3-9964-40ec-91e3-e2aa8166f007 with Priority: HIGHEST for action security_group_members [ 683.862312] env[67094]: INFO networking_nsxv3.common.synchronization [req-c1a816d9-7c4b-4ae6-879a-6bba3bfa369f req-24c33e8d-e7ed-45e8-a834-5465fa6a3767 service nova] Enqueued Resource ID: e38e7960-e93e-4cd0-a437-2d17f9d1a161 with Priority: HIGHEST for action port [ 683.862805] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00b541f3-9964-40ec-91e3-e2aa8166f007 with Priority: HIGHEST for action security_group_rules [ 683.862985] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00b541f3-9964-40ec-91e3-e2aa8166f007 with Priority: HIGHEST for action security_group_members [ 683.863453] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e38e7960-e93e-4cd0-a437-2d17f9d1a161 with Priority: HIGHEST for action port [ 683.864271] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00b541f3-9964-40ec-91e3-e2aa8166f007 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.864387] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00b541f3-9964-40ec-91e3-e2aa8166f007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.864425] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00b541f3-9964-40ec-91e3-e2aa8166f007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.864729] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00b541f3-9964-40ec-91e3-e2aa8166f007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.864880] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00b541f3-9964-40ec-91e3-e2aa8166f007',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.865749] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-00b541f3-9964-40ec-91e3-e2aa8166f007 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.865868] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00b541f3-9964-40ec-91e3-e2aa8166f007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.865929] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00b541f3-9964-40ec-91e3-e2aa8166f007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.866157] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00b541f3-9964-40ec-91e3-e2aa8166f007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.866327] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.866447] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.866507] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.866659] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.866763] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 683.866874] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00b541f3-9964-40ec-91e3-e2aa8166f007',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 683.867823] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-e38e7960-e93e-4cd0-a437-2d17f9d1a161 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 683.867930] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e38e7960-e93e-4cd0-a437-2d17f9d1a161" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 683.867993] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e38e7960-e93e-4cd0-a437-2d17f9d1a161" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 683.868206] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e38e7960-e93e-4cd0-a437-2d17f9d1a161" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 683.868328] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e38e7960-e93e-4cd0-a437-2d17f9d1a161',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.371330] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-00b541f3-9964-40ec-91e3-e2aa8166f007 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.371485] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00b541f3-9964-40ec-91e3-e2aa8166f007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.371638] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00b541f3-9964-40ec-91e3-e2aa8166f007',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.372548] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e38e7960-e93e-4cd0-a437-2d17f9d1a161 with status ACTIVE [ 684.372731] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.372841] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.372917] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.373117] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.373210] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.373391] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.373490] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.373542] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.373686] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.373774] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.373958] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.374846] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.375952] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.376157] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.377328] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.377328] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e38e7960-e93e-4cd0-a437-2d17f9d1a161 is going to be updated. [ 684.408494] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.408494] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.408494] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.408494] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.408494] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.408494] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e38e7960-e93e-4cd0-a437-2d17f9d1a161" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.535542] env[67094]: INFO networking_nsxv3.common.synchronization [req-a11e5ae9-5d4a-4c57-875f-22e9e7cc9278 req-f4643f9d-2f33-483a-a39c-894844d539fe tempest-AttachVolumeTestJSON-829034394 tempest-AttachVolumeTestJSON-829034394-project-member] Enqueued Resource ID: 00f05527-967f-4b60-a2ba-dd3e2d9bad21 with Priority: HIGHEST for action security_group_members [ 684.536123] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00f05527-967f-4b60-a2ba-dd3e2d9bad21 with Priority: HIGHEST for action security_group_members [ 684.536434] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-00f05527-967f-4b60-a2ba-dd3e2d9bad21 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.536552] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00f05527-967f-4b60-a2ba-dd3e2d9bad21" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.536612] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00f05527-967f-4b60-a2ba-dd3e2d9bad21" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.536868] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00f05527-967f-4b60-a2ba-dd3e2d9bad21" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.537051] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.537151] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.537254] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.537699] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.537699] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.537699] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00f05527-967f-4b60-a2ba-dd3e2d9bad21',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.795919] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34103f55-eb7e-4602-9672-09596df7eaa4 in Status: SUCCESS [ 684.796202] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-34103f55-eb7e-4602-9672-09596df7eaa4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.879689] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00b541f3-9964-40ec-91e3-e2aa8166f007',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 684.976264] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52851555-797a-47ba-b408-d4557f3f4ec2 in Status: SUCCESS [ 684.976538] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52851555-797a-47ba-b408-d4557f3f4ec2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.976747] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52851555-797a-47ba-b408-d4557f3f4ec2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.977042] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52851555-797a-47ba-b408-d4557f3f4ec2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.977332] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 684.977468] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 684.977545] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 684.977769] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 684.977867] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.977943] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52851555-797a-47ba-b408-d4557f3f4ec2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 684.978141] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('52851555-797a-47ba-b408-d4557f3f4ec2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.040665] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.040876] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.040946] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.041864] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.041864] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.041864] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.041864] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.041864] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.042191] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.042191] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.042322] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00f05527-967f-4b60-a2ba-dd3e2d9bad21 already deleted. [ 685.042465] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00f05527-967f-4b60-a2ba-dd3e2d9bad21" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.067442] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock network-166 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.067929] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "network-166" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.067929] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "network-166" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.068272] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "network-166" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.068446] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.068666] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.068769] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.069070] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.069293] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.069490] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 685.069599] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 685.069749] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 685.069930] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 685.070150] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 685.070207] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 685.071449] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 685.094221] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 685.094427] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 685.094608] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 685.094758] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "network-166" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.095125] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock port-a826d570-2a94-4cfe-ad12-836264a2e739 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.095373] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "port-a826d570-2a94-4cfe-ad12-836264a2e739" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.095521] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "port-a826d570-2a94-4cfe-ad12-836264a2e739" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.095866] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "port-a826d570-2a94-4cfe-ad12-836264a2e739" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.096115] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a826d570-2a94-4cfe-ad12-836264a2e739',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.385917] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.386515] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.386721] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.387198] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.388365] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.388365] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00b541f3-9964-40ec-91e3-e2aa8166f007 is going to be created. [ 685.434475] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.434766] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.435799] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.435799] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.435799] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.463241] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00b541f3-9964-40ec-91e3-e2aa8166f007 in Status: UNINITIALIZED for 2s [ 685.481351] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-52851555-797a-47ba-b408-d4557f3f4ec2 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.481534] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52851555-797a-47ba-b408-d4557f3f4ec2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.481608] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52851555-797a-47ba-b408-d4557f3f4ec2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.481833] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52851555-797a-47ba-b408-d4557f3f4ec2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.482008] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.482129] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.482245] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.482486] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.482656] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.482822] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52851555-797a-47ba-b408-d4557f3f4ec2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.483088] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-52851555-797a-47ba-b408-d4557f3f4ec2 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.483242] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52851555-797a-47ba-b408-d4557f3f4ec2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.483342] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52851555-797a-47ba-b408-d4557f3f4ec2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.483612] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52851555-797a-47ba-b408-d4557f3f4ec2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.483836] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.483978] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.484089] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.484300] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.484419] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.484543] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52851555-797a-47ba-b408-d4557f3f4ec2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.484675] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('52851555-797a-47ba-b408-d4557f3f4ec2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 685.599304] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.599598] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.599847] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.599991] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.600160] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.600316] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Segment Port a826d570-2a94-4cfe-ad12-836264a2e739 not found, creating... [ 685.600575] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.600733] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.600894] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.601055] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.601192] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.601552] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.601789] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.601969] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.602179] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.602343] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.602461] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Resource: SegmentPort with ID: a826d570-2a94-4cfe-ad12-836264a2e739 is going to be created. [ 685.627932] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 685.628330] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 685.628536] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 685.629382] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 685.629659] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.629910] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "port-a826d570-2a94-4cfe-ad12-836264a2e739" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 685.987485] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 52851555-797a-47ba-b408-d4557f3f4ec2: rpc.has_security_group_logging(os_id): False [ 686.006365] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.006365] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.006365] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.006365] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.006365] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.006665] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.006665] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.006768] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.006853] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.006927] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.007112] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.007274] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.007350] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.007494] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.007569] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.007744] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.007831] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.007887] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.008030] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.008107] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.008193] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 52851555-797a-47ba-b408-d4557f3f4ec2 is going to be created. [ 686.090849] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.091075] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.091189] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.091611] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.091844] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.105321] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 52851555-797a-47ba-b408-d4557f3f4ec2 in Status: IN_PROGRESS for 2s [ 686.390926] env[67094]: INFO networking_nsxv3.common.synchronization [req-a11e5ae9-5d4a-4c57-875f-22e9e7cc9278 req-5cd82108-de7f-4249-9d33-dd58347baee9 service nova] Enqueued Resource ID: 00f05527-967f-4b60-a2ba-dd3e2d9bad21 with Priority: HIGHEST for action security_group_rules [ 686.391118] env[67094]: INFO networking_nsxv3.common.synchronization [req-a11e5ae9-5d4a-4c57-875f-22e9e7cc9278 req-5cd82108-de7f-4249-9d33-dd58347baee9 service nova] Enqueued Resource ID: 00f05527-967f-4b60-a2ba-dd3e2d9bad21 with Priority: HIGHEST for action security_group_members [ 686.391249] env[67094]: INFO networking_nsxv3.common.synchronization [req-a11e5ae9-5d4a-4c57-875f-22e9e7cc9278 req-5cd82108-de7f-4249-9d33-dd58347baee9 service nova] Enqueued Resource ID: a826d570-2a94-4cfe-ad12-836264a2e739 with Priority: HIGHEST for action port [ 686.392702] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00f05527-967f-4b60-a2ba-dd3e2d9bad21 with Priority: HIGHEST for action security_group_rules [ 686.392702] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00f05527-967f-4b60-a2ba-dd3e2d9bad21 with Priority: HIGHEST for action security_group_members [ 686.392702] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a826d570-2a94-4cfe-ad12-836264a2e739 with Priority: HIGHEST for action port [ 686.392702] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00f05527-967f-4b60-a2ba-dd3e2d9bad21 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.392702] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00f05527-967f-4b60-a2ba-dd3e2d9bad21" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.392702] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00f05527-967f-4b60-a2ba-dd3e2d9bad21" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.393241] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00f05527-967f-4b60-a2ba-dd3e2d9bad21" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.393241] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00f05527-967f-4b60-a2ba-dd3e2d9bad21',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.393724] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-00f05527-967f-4b60-a2ba-dd3e2d9bad21 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.393834] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00f05527-967f-4b60-a2ba-dd3e2d9bad21" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.393900] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00f05527-967f-4b60-a2ba-dd3e2d9bad21" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.394090] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00f05527-967f-4b60-a2ba-dd3e2d9bad21" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.394654] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.394654] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.394654] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.394654] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.394654] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.395098] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00f05527-967f-4b60-a2ba-dd3e2d9bad21',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.396135] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-a826d570-2a94-4cfe-ad12-836264a2e739 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.396135] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a826d570-2a94-4cfe-ad12-836264a2e739" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.396135] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a826d570-2a94-4cfe-ad12-836264a2e739" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.396135] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a826d570-2a94-4cfe-ad12-836264a2e739" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.396135] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a826d570-2a94-4cfe-ad12-836264a2e739',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.898598] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-00f05527-967f-4b60-a2ba-dd3e2d9bad21 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.899605] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00f05527-967f-4b60-a2ba-dd3e2d9bad21" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.899605] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00f05527-967f-4b60-a2ba-dd3e2d9bad21',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 686.900860] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a826d570-2a94-4cfe-ad12-836264a2e739 with status ACTIVE [ 686.901087] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.901426] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.901426] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.901643] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.901769] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.902017] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.902185] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.902239] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.902452] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.902589] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.902795] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.902915] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.902991] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.903666] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.903666] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.904030] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a826d570-2a94-4cfe-ad12-836264a2e739 is going to be updated. [ 686.974428] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 686.974428] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 686.974428] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 686.974428] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 686.974428] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 686.974428] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a826d570-2a94-4cfe-ad12-836264a2e739" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.406858] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00f05527-967f-4b60-a2ba-dd3e2d9bad21',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.474159] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00b541f3-9964-40ec-91e3-e2aa8166f007 in Status: SUCCESS [ 687.475528] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00b541f3-9964-40ec-91e3-e2aa8166f007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.475713] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00b541f3-9964-40ec-91e3-e2aa8166f007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.476256] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00b541f3-9964-40ec-91e3-e2aa8166f007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.476256] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.476640] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.476750] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.477225] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.477225] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.477225] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00b541f3-9964-40ec-91e3-e2aa8166f007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.477377] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('00b541f3-9964-40ec-91e3-e2aa8166f007',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.747815] env[67094]: INFO networking_nsxv3.common.synchronization [req-bd8f0d4c-7587-4845-8754-9db28025702b req-a6a14046-a840-449e-8f75-a7c5dabf8cc9 tempest-ServersTestJSON-1070791530 tempest-ServersTestJSON-1070791530-project-member] Enqueued Resource ID: c0881101-1be1-4dbf-ac18-2d54a689202c with Priority: HIGHEST for action security_group_members [ 687.748561] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0881101-1be1-4dbf-ac18-2d54a689202c with Priority: HIGHEST for action security_group_members [ 687.750386] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0881101-1be1-4dbf-ac18-2d54a689202c taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.750578] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.750666] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.750911] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.751130] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.751738] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.751738] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.751738] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.751738] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.751738] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 687.910836] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.911013] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.911149] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.911412] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.911563] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.911599] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00f05527-967f-4b60-a2ba-dd3e2d9bad21 is going to be created. [ 687.938653] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 687.938653] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 687.938653] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 687.938943] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 687.939307] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 687.952130] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00f05527-967f-4b60-a2ba-dd3e2d9bad21 in Status: UNINITIALIZED for 2s [ 687.980231] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('00b541f3-9964-40ec-91e3-e2aa8166f007',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.120577] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 52851555-797a-47ba-b408-d4557f3f4ec2 in Status: SUCCESS [ 688.121123] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-52851555-797a-47ba-b408-d4557f3f4ec2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.254453] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.483825] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 00b541f3-9964-40ec-91e3-e2aa8166f007: rpc.has_security_group_logging(os_id): False [ 688.515773] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.515917] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.516026] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.516272] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.516376] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.516653] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.516764] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.516829] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.516985] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.517074] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.517160] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00b541f3-9964-40ec-91e3-e2aa8166f007 is going to be created. [ 688.542851] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock network-91 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.543033] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "network-91" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.543138] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "network-91" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.543403] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "network-91" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.543651] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.543800] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.544341] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.545088] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.545088] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.545373] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 688.546244] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 688.546244] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 688.546244] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 688.546244] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 688.546409] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 688.546409] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 688.569310] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 688.569625] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 688.569773] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 688.570428] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "network-91" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.570428] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock port-c3630f59-cc2c-455a-b00e-aae1f3d292b0 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.570428] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "port-c3630f59-cc2c-455a-b00e-aae1f3d292b0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.570659] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "port-c3630f59-cc2c-455a-b00e-aae1f3d292b0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.570857] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "port-c3630f59-cc2c-455a-b00e-aae1f3d292b0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.570988] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3630f59-cc2c-455a-b00e-aae1f3d292b0',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 688.592797] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 688.592944] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 688.593021] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 688.593274] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 688.593459] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 688.607806] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00b541f3-9964-40ec-91e3-e2aa8166f007 in Status: IN_PROGRESS for 2s [ 688.757118] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.073296] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.073637] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.073812] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.074161] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.074352] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.074555] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Segment Port c3630f59-cc2c-455a-b00e-aae1f3d292b0 not found, creating... [ 689.074967] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.075222] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.075961] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.076598] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.076980] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.078260] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.078439] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.078604] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.079028] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.079264] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.080032] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Resource: SegmentPort with ID: c3630f59-cc2c-455a-b00e-aae1f3d292b0 is going to be created. [ 689.107206] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.108616] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.108616] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.108616] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.108616] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.108616] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "port-c3630f59-cc2c-455a-b00e-aae1f3d292b0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.260118] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.260432] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.260669] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.261074] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.261228] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.261460] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0881101-1be1-4dbf-ac18-2d54a689202c is going to be updated. [ 689.325172] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.325431] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.325586] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.325760] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.325913] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.344095] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0881101-1be1-4dbf-ac18-2d54a689202c in Status: IN_PROGRESS for 2s [ 689.842937] env[67094]: INFO networking_nsxv3.common.synchronization [req-bd8f0d4c-7587-4845-8754-9db28025702b req-04145373-10e4-415d-ab04-2ec42011876b service nova] Enqueued Resource ID: c0881101-1be1-4dbf-ac18-2d54a689202c with Priority: HIGHEST for action security_group_rules [ 689.843216] env[67094]: INFO networking_nsxv3.common.synchronization [req-bd8f0d4c-7587-4845-8754-9db28025702b req-04145373-10e4-415d-ab04-2ec42011876b service nova] Enqueued Resource ID: c0881101-1be1-4dbf-ac18-2d54a689202c with Priority: HIGHEST for action security_group_members [ 689.843299] env[67094]: INFO networking_nsxv3.common.synchronization [req-bd8f0d4c-7587-4845-8754-9db28025702b req-04145373-10e4-415d-ab04-2ec42011876b service nova] Enqueued Resource ID: c3630f59-cc2c-455a-b00e-aae1f3d292b0 with Priority: HIGHEST for action port [ 689.843998] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0881101-1be1-4dbf-ac18-2d54a689202c with Priority: HIGHEST for action security_group_rules [ 689.843998] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0881101-1be1-4dbf-ac18-2d54a689202c with Priority: HIGHEST for action security_group_members [ 689.844154] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c3630f59-cc2c-455a-b00e-aae1f3d292b0 with Priority: HIGHEST for action port [ 689.844496] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0881101-1be1-4dbf-ac18-2d54a689202c taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.844590] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.844621] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.844812] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.844894] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.845761] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0881101-1be1-4dbf-ac18-2d54a689202c taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.845851] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.846044] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-c3630f59-cc2c-455a-b00e-aae1f3d292b0 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.846181] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c3630f59-cc2c-455a-b00e-aae1f3d292b0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.846214] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c3630f59-cc2c-455a-b00e-aae1f3d292b0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.846436] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c3630f59-cc2c-455a-b00e-aae1f3d292b0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.846436] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c3630f59-cc2c-455a-b00e-aae1f3d292b0',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 689.968578] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00f05527-967f-4b60-a2ba-dd3e2d9bad21 in Status: SUCCESS [ 689.968835] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00f05527-967f-4b60-a2ba-dd3e2d9bad21" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.970389] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00f05527-967f-4b60-a2ba-dd3e2d9bad21" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.970725] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00f05527-967f-4b60-a2ba-dd3e2d9bad21" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.971332] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 689.971795] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 689.972066] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 689.972528] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 689.972708] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.973298] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00f05527-967f-4b60-a2ba-dd3e2d9bad21" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 689.973450] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('00f05527-967f-4b60-a2ba-dd3e2d9bad21',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.348250] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0881101-1be1-4dbf-ac18-2d54a689202c taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.348556] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.349796] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c3630f59-cc2c-455a-b00e-aae1f3d292b0 with status ACTIVE [ 690.349995] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.350152] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.350220] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.350450] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.350562] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.350766] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.350907] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.351010] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.353541] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.353541] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.353541] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.353541] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.353541] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.353541] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.353541] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.353541] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c3630f59-cc2c-455a-b00e-aae1f3d292b0 is going to be updated. [ 690.379300] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.379567] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.379818] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.379957] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.380124] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.380325] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c3630f59-cc2c-455a-b00e-aae1f3d292b0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.477844] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('00f05527-967f-4b60-a2ba-dd3e2d9bad21',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.628404] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00b541f3-9964-40ec-91e3-e2aa8166f007 in Status: SUCCESS [ 690.628724] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00b541f3-9964-40ec-91e3-e2aa8166f007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.810055] env[67094]: INFO networking_nsxv3.common.synchronization [req-d21ed7af-ec5d-447e-bcb1-db054e45ff25 req-cfc19553-f9bf-4a45-8c77-7074d3fd52ae tempest-FloatingIPsAssociationNegativeTestJSON-944970584 tempest-FloatingIPsAssociationNegativeTestJSON-944970584-project-member] Enqueued Resource ID: 62f0dd40-a793-48dd-b62a-abaa0eeebd45 with Priority: HIGHEST for action security_group_members [ 690.810567] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 62f0dd40-a793-48dd-b62a-abaa0eeebd45 with Priority: HIGHEST for action security_group_members [ 690.810903] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-62f0dd40-a793-48dd-b62a-abaa0eeebd45 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.811194] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-62f0dd40-a793-48dd-b62a-abaa0eeebd45" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.811540] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-62f0dd40-a793-48dd-b62a-abaa0eeebd45" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.811609] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-62f0dd40-a793-48dd-b62a-abaa0eeebd45" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.811726] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 690.811826] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 690.811891] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 690.812051] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 690.812141] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 690.812236] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('62f0dd40-a793-48dd-b62a-abaa0eeebd45',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 690.985214] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 00f05527-967f-4b60-a2ba-dd3e2d9bad21: rpc.has_security_group_logging(os_id): False [ 691.008077] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.008305] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.008504] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.008748] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.008847] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.009139] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.009263] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.009335] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.009494] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.009588] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.009696] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00f05527-967f-4b60-a2ba-dd3e2d9bad21 is going to be created. [ 691.083598] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.083783] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.083860] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.084109] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.084303] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.107951] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00f05527-967f-4b60-a2ba-dd3e2d9bad21 in Status: IN_PROGRESS for 2s [ 691.219030] env[67094]: INFO networking_nsxv3.common.synchronization [req-22995241-499a-455b-b800-eb84b189637e req-de0fb45d-9591-44f0-88f5-7abab4fedfc6 tempest-ServerMetadataTestJSON-916132385 tempest-ServerMetadataTestJSON-916132385-project-member] Enqueued Resource ID: 4e31526a-4068-4c26-bce5-72c9c1c3964e with Priority: HIGHEST for action security_group_members [ 691.219820] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e31526a-4068-4c26-bce5-72c9c1c3964e with Priority: HIGHEST for action security_group_members [ 691.220506] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-4e31526a-4068-4c26-bce5-72c9c1c3964e taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.220660] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4e31526a-4068-4c26-bce5-72c9c1c3964e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.220734] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4e31526a-4068-4c26-bce5-72c9c1c3964e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.220995] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4e31526a-4068-4c26-bce5-72c9c1c3964e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.221186] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.221314] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.221401] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.221596] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.221719] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.221840] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4e31526a-4068-4c26-bce5-72c9c1c3964e',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.314448] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.314817] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.314817] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.315219] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.315219] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.315481] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.315586] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.315650] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.315829] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.315957] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.316022] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 62f0dd40-a793-48dd-b62a-abaa0eeebd45 is going to be updated. [ 691.349261] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.349261] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.349504] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.350523] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.350523] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.354979] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0881101-1be1-4dbf-ac18-2d54a689202c in Status: SUCCESS [ 691.355322] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.355580] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.355900] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.356282] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.356775] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.356775] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.357181] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.357345] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.358360] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.361784] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 62f0dd40-a793-48dd-b62a-abaa0eeebd45 in Status: IN_PROGRESS for 2s [ 691.552509] env[67094]: INFO networking_nsxv3.common.synchronization [None req-3840b779-72b9-4d47-88e2-85844fb1dd96 None None] Enqueued Resource ID: 851f8392-1a61-4d26-8baf-c20703a06309 with Priority: HIGHEST for action port [ 691.553107] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 851f8392-1a61-4d26-8baf-c20703a06309 with Priority: HIGHEST for action port [ 691.553455] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-851f8392-1a61-4d26-8baf-c20703a06309 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.553542] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-851f8392-1a61-4d26-8baf-c20703a06309" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.553613] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-851f8392-1a61-4d26-8baf-c20703a06309" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.553860] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-851f8392-1a61-4d26-8baf-c20703a06309" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.553944] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('851f8392-1a61-4d26-8baf-c20703a06309',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 691.730070] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.730070] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.730070] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.730070] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.730070] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.730070] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.730070] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.730070] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.730070] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.730070] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.730070] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e31526a-4068-4c26-bce5-72c9c1c3964e is going to be updated. [ 691.772718] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 691.772997] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 691.772997] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 691.773252] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 691.773433] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 691.786653] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e31526a-4068-4c26-bce5-72c9c1c3964e in Status: IN_PROGRESS for 2s [ 691.860539] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.057950] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 851f8392-1a61-4d26-8baf-c20703a06309 [ 692.058360] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.058360] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.058466] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.058677] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.058852] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.058898] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:851f8392-1a61-4d26-8baf-c20703a06309 already deleted. [ 692.059013] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-851f8392-1a61-4d26-8baf-c20703a06309" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.283307] env[67094]: INFO networking_nsxv3.common.synchronization [req-f02eb75f-4122-4e33-9304-b9784f4dd755 req-ce6be3ca-481a-49e1-a75e-1f44f9a88e87 tempest-AttachInterfacesTestJSON-1117082489 tempest-AttachInterfacesTestJSON-1117082489-project-member] Enqueued Resource ID: eb77eddf-2e1d-485c-bfe8-67d4c174dc73 with Priority: HIGHEST for action security_group_members [ 692.283904] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb77eddf-2e1d-485c-bfe8-67d4c174dc73 with Priority: HIGHEST for action security_group_members [ 692.284219] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb77eddf-2e1d-485c-bfe8-67d4c174dc73 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.284344] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb77eddf-2e1d-485c-bfe8-67d4c174dc73" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.284394] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb77eddf-2e1d-485c-bfe8-67d4c174dc73" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.284670] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb77eddf-2e1d-485c-bfe8-67d4c174dc73" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.284825] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.284921] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.285067] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.289900] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.290140] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.290332] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb77eddf-2e1d-485c-bfe8-67d4c174dc73',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.364363] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.423077] env[67094]: INFO networking_nsxv3.common.synchronization [None req-0ba3037d-7e56-4b54-898d-d8a1dbee7729 None None] Enqueued Resource ID: 914560e4-b56a-4d8c-82ef-7f1856c96b28 with Priority: HIGHEST for action port [ 692.423633] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 914560e4-b56a-4d8c-82ef-7f1856c96b28 with Priority: HIGHEST for action port [ 692.424959] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-914560e4-b56a-4d8c-82ef-7f1856c96b28 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.424959] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-914560e4-b56a-4d8c-82ef-7f1856c96b28" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.424959] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-914560e4-b56a-4d8c-82ef-7f1856c96b28" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.424959] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-914560e4-b56a-4d8c-82ef-7f1856c96b28" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.424959] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('914560e4-b56a-4d8c-82ef-7f1856c96b28',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 692.794474] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.794474] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.794474] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.794474] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.794474] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.794474] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.797600] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.797600] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.797600] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.797600] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.797600] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb77eddf-2e1d-485c-bfe8-67d4c174dc73 already deleted. [ 692.797600] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb77eddf-2e1d-485c-bfe8-67d4c174dc73" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.866826] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.867036] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.867126] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.867415] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.867520] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.867844] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0881101-1be1-4dbf-ac18-2d54a689202c is going to be updated. [ 692.905178] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.905526] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.905625] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.905891] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.906123] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.917764] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0881101-1be1-4dbf-ac18-2d54a689202c in Status: IN_PROGRESS for 2s [ 692.926529] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 914560e4-b56a-4d8c-82ef-7f1856c96b28 [ 692.926799] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 692.926930] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 692.931017] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 692.931017] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 692.931017] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 692.931017] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:914560e4-b56a-4d8c-82ef-7f1856c96b28 already deleted. [ 692.931017] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-914560e4-b56a-4d8c-82ef-7f1856c96b28" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.123641] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00f05527-967f-4b60-a2ba-dd3e2d9bad21 in Status: SUCCESS [ 693.123641] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00f05527-967f-4b60-a2ba-dd3e2d9bad21" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.368907] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock network-766 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.369719] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "network-766" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.369837] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "network-766" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.370170] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "network-766" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.370475] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.371109] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.371109] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.371109] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.371109] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.371313] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 693.371438] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 693.371719] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 693.371719] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 693.371719] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 693.371870] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 693.371937] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 693.373622] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 62f0dd40-a793-48dd-b62a-abaa0eeebd45 in Status: SUCCESS [ 693.374109] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 62f0dd40-a793-48dd-b62a-abaa0eeebd45 deletion is rescheduled due to dependency. [ 693.374109] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-62f0dd40-a793-48dd-b62a-abaa0eeebd45" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.391603] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 693.391735] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 693.391861] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 693.392045] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "network-766" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.392347] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock port-c0abf057-1fda-4ac0-b489-7b70353dac49 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.392542] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "port-c0abf057-1fda-4ac0-b489-7b70353dac49" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.392653] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "port-c0abf057-1fda-4ac0-b489-7b70353dac49" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.392952] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "port-c0abf057-1fda-4ac0-b489-7b70353dac49" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.393090] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0abf057-1fda-4ac0-b489-7b70353dac49',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.504228] env[67094]: INFO networking_nsxv3.common.synchronization [None req-fb2acdd6-4689-4cdc-bd0b-5343fa89c7df None None] Enqueued Resource ID: 7d0a44b3-0cff-4901-8e9b-ca6c5b8b65d2 with Priority: HIGHEST for action port [ 693.505159] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d0a44b3-0cff-4901-8e9b-ca6c5b8b65d2 with Priority: HIGHEST for action port [ 693.505603] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-7d0a44b3-0cff-4901-8e9b-ca6c5b8b65d2 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.505687] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7d0a44b3-0cff-4901-8e9b-ca6c5b8b65d2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.505687] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7d0a44b3-0cff-4901-8e9b-ca6c5b8b65d2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.505945] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7d0a44b3-0cff-4901-8e9b-ca6c5b8b65d2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.506072] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7d0a44b3-0cff-4901-8e9b-ca6c5b8b65d2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 693.797025] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4e31526a-4068-4c26-bce5-72c9c1c3964e in Status: SUCCESS [ 693.797346] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4e31526a-4068-4c26-bce5-72c9c1c3964e deletion is rescheduled due to dependency. [ 693.797509] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4e31526a-4068-4c26-bce5-72c9c1c3964e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.895480] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.895783] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.895919] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.897886] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.897886] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.897886] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Segment Port c0abf057-1fda-4ac0-b489-7b70353dac49 not found, creating... [ 693.897886] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.897886] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.897886] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.897886] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.897886] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.897886] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.898673] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.898673] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.898673] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.898673] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.899172] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Resource: SegmentPort with ID: c0abf057-1fda-4ac0-b489-7b70353dac49 is going to be created. [ 693.922665] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 693.923043] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 693.923295] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 693.923660] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 693.924045] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 693.924411] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "port-c0abf057-1fda-4ac0-b489-7b70353dac49" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.013042] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7d0a44b3-0cff-4901-8e9b-ca6c5b8b65d2 [ 694.013042] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.013042] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.013042] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.013042] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.013042] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.013042] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7d0a44b3-0cff-4901-8e9b-ca6c5b8b65d2 already deleted. [ 694.013042] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7d0a44b3-0cff-4901-8e9b-ca6c5b8b65d2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.174272] env[67094]: INFO networking_nsxv3.common.synchronization [None req-316fed49-fc10-4529-aa7a-b66d2f163017 None None] Enqueued Resource ID: 76627b89-72e0-4341-9bc4-9dfa1a9deb08 with Priority: HIGHEST for action port [ 694.175025] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 76627b89-72e0-4341-9bc4-9dfa1a9deb08 with Priority: HIGHEST for action port [ 694.175408] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-76627b89-72e0-4341-9bc4-9dfa1a9deb08 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.175504] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-76627b89-72e0-4341-9bc4-9dfa1a9deb08" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.175553] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-76627b89-72e0-4341-9bc4-9dfa1a9deb08" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.175806] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-76627b89-72e0-4341-9bc4-9dfa1a9deb08" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.175900] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('76627b89-72e0-4341-9bc4-9dfa1a9deb08',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.679039] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 76627b89-72e0-4341-9bc4-9dfa1a9deb08 [ 694.679039] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.679039] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.679039] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.679039] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.679039] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.679039] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:76627b89-72e0-4341-9bc4-9dfa1a9deb08 already deleted. [ 694.679039] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-76627b89-72e0-4341-9bc4-9dfa1a9deb08" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.732800] env[67094]: INFO networking_nsxv3.common.synchronization [req-f02eb75f-4122-4e33-9304-b9784f4dd755 req-7d2999de-007d-4ccb-8f3b-75bc183f5619 service nova] Enqueued Resource ID: eb77eddf-2e1d-485c-bfe8-67d4c174dc73 with Priority: HIGHEST for action security_group_rules [ 694.732969] env[67094]: INFO networking_nsxv3.common.synchronization [req-f02eb75f-4122-4e33-9304-b9784f4dd755 req-7d2999de-007d-4ccb-8f3b-75bc183f5619 service nova] Enqueued Resource ID: eb77eddf-2e1d-485c-bfe8-67d4c174dc73 with Priority: HIGHEST for action security_group_members [ 694.733125] env[67094]: INFO networking_nsxv3.common.synchronization [req-f02eb75f-4122-4e33-9304-b9784f4dd755 req-7d2999de-007d-4ccb-8f3b-75bc183f5619 service nova] Enqueued Resource ID: c0abf057-1fda-4ac0-b489-7b70353dac49 with Priority: HIGHEST for action port [ 694.733796] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb77eddf-2e1d-485c-bfe8-67d4c174dc73 with Priority: HIGHEST for action security_group_rules [ 694.733979] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb77eddf-2e1d-485c-bfe8-67d4c174dc73 with Priority: HIGHEST for action security_group_members [ 694.736946] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0abf057-1fda-4ac0-b489-7b70353dac49 with Priority: HIGHEST for action port [ 694.737412] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eb77eddf-2e1d-485c-bfe8-67d4c174dc73 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.737599] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eb77eddf-2e1d-485c-bfe8-67d4c174dc73" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.737750] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eb77eddf-2e1d-485c-bfe8-67d4c174dc73" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.740641] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eb77eddf-2e1d-485c-bfe8-67d4c174dc73" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.740778] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eb77eddf-2e1d-485c-bfe8-67d4c174dc73',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.741936] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb77eddf-2e1d-485c-bfe8-67d4c174dc73 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.742124] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb77eddf-2e1d-485c-bfe8-67d4c174dc73" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.742224] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb77eddf-2e1d-485c-bfe8-67d4c174dc73" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.742567] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb77eddf-2e1d-485c-bfe8-67d4c174dc73" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.742767] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.742920] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.743014] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.743226] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.743336] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.743437] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb77eddf-2e1d-485c-bfe8-67d4c174dc73',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.750037] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-c0abf057-1fda-4ac0-b489-7b70353dac49 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.750037] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c0abf057-1fda-4ac0-b489-7b70353dac49" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.750037] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c0abf057-1fda-4ac0-b489-7b70353dac49" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.750037] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c0abf057-1fda-4ac0-b489-7b70353dac49" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.750037] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c0abf057-1fda-4ac0-b489-7b70353dac49',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 694.929276] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0881101-1be1-4dbf-ac18-2d54a689202c in Status: SUCCESS [ 694.929779] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.929779] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.930239] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.930239] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 694.930920] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 694.930920] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 694.930920] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 694.930920] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.930920] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 694.930920] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.251124] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb77eddf-2e1d-485c-bfe8-67d4c174dc73 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.251467] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb77eddf-2e1d-485c-bfe8-67d4c174dc73" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.251566] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('eb77eddf-2e1d-485c-bfe8-67d4c174dc73',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.252595] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c0abf057-1fda-4ac0-b489-7b70353dac49 with status ACTIVE [ 695.252787] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.252900] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.253130] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.253284] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.253329] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.253489] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.255191] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.255191] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.255191] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.255191] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.255191] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.255191] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.255191] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.255191] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.255191] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.255191] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c0abf057-1fda-4ac0-b489-7b70353dac49 is going to be updated. [ 695.280487] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.280703] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.280703] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.280924] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.281077] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.281669] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c0abf057-1fda-4ac0-b489-7b70353dac49" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.433024] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0881101-1be1-4dbf-ac18-2d54a689202c taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.433263] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.433380] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.433994] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.433994] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.433994] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.434174] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.434305] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.435673] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.435673] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.435673] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0881101-1be1-4dbf-ac18-2d54a689202c taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.435673] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.435673] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.435673] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.435673] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.435673] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.435673] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.436515] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.436666] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.436811] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.437060] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.756933] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('eb77eddf-2e1d-485c-bfe8-67d4c174dc73',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 695.939869] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c0881101-1be1-4dbf-ac18-2d54a689202c: rpc.has_security_group_logging(os_id): False [ 695.960976] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.961148] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.961233] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.961467] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.961649] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.961763] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.961862] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.961925] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.962636] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.962636] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.962636] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.962636] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.962636] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.962817] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.962817] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.962975] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 695.963232] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 695.963296] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 695.964193] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 695.964193] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 695.964193] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0881101-1be1-4dbf-ac18-2d54a689202c is going to be updated. [ 696.042184] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.042614] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.042738] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.042969] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.043175] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.060555] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0881101-1be1-4dbf-ac18-2d54a689202c in Status: IN_PROGRESS for 2s [ 696.260008] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.260008] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.260519] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.260519] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.260519] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.260673] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb77eddf-2e1d-485c-bfe8-67d4c174dc73 is going to be created. [ 696.273636] env[67094]: INFO networking_nsxv3.common.synchronization [None req-504fc3d4-b3cc-4db2-8542-45a9c6a4024b None None] Enqueued Resource ID: 5cbaf6fc-0336-459b-8f94-834a6f10f941 with Priority: HIGHEST for action port [ 696.274338] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5cbaf6fc-0336-459b-8f94-834a6f10f941 with Priority: HIGHEST for action port [ 696.274642] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-5cbaf6fc-0336-459b-8f94-834a6f10f941 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.274967] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5cbaf6fc-0336-459b-8f94-834a6f10f941" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.275099] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5cbaf6fc-0336-459b-8f94-834a6f10f941" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.275461] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5cbaf6fc-0336-459b-8f94-834a6f10f941" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.275598] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5cbaf6fc-0336-459b-8f94-834a6f10f941',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 696.304256] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.304256] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.304256] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.304256] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.304256] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.316762] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb77eddf-2e1d-485c-bfe8-67d4c174dc73 in Status: UNINITIALIZED for 2s [ 696.778957] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5cbaf6fc-0336-459b-8f94-834a6f10f941 [ 696.778957] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 696.778957] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 696.778957] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 696.778957] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 696.778957] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 696.778957] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5cbaf6fc-0336-459b-8f94-834a6f10f941 already deleted. [ 696.778957] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5cbaf6fc-0336-459b-8f94-834a6f10f941" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.079694] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0881101-1be1-4dbf-ac18-2d54a689202c in Status: SUCCESS [ 698.081920] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.123473] env[67094]: INFO networking_nsxv3.common.synchronization [req-6f9c5590-94b1-46ff-b58c-3b34d8057268 req-3a4b7c6c-78a9-45af-9156-04655751e2a3 tempest-ServerTagsTestJSON-1326017937 tempest-ServerTagsTestJSON-1326017937-project-member] Enqueued Resource ID: 0e314269-1025-4c1f-b42e-8acab2134cbb with Priority: HIGHEST for action security_group_members [ 698.125816] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e314269-1025-4c1f-b42e-8acab2134cbb with Priority: HIGHEST for action security_group_members [ 698.127224] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e314269-1025-4c1f-b42e-8acab2134cbb taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.127415] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e314269-1025-4c1f-b42e-8acab2134cbb" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.127611] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e314269-1025-4c1f-b42e-8acab2134cbb" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.127995] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e314269-1025-4c1f-b42e-8acab2134cbb" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.128188] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.128328] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.129027] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.129027] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.129027] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.129027] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e314269-1025-4c1f-b42e-8acab2134cbb',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.329832] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb77eddf-2e1d-485c-bfe8-67d4c174dc73 in Status: SUCCESS [ 698.329877] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb77eddf-2e1d-485c-bfe8-67d4c174dc73" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.330114] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb77eddf-2e1d-485c-bfe8-67d4c174dc73" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.330343] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb77eddf-2e1d-485c-bfe8-67d4c174dc73" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.331053] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.331053] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.331597] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.331597] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.331597] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.331597] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb77eddf-2e1d-485c-bfe8-67d4c174dc73" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.331597] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eb77eddf-2e1d-485c-bfe8-67d4c174dc73',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.519709] env[67094]: INFO networking_nsxv3.common.synchronization [None req-4e52c3df-e5c1-4cd2-bb25-3bdbbb8044f6 tempest-MigrationsAdminTest-1501090521 tempest-MigrationsAdminTest-1501090521-project-member] Enqueued Resource ID: 25aa3e8f-013d-4e35-addc-3d9537ebd75b with Priority: HIGHEST for action security_group_rules [ 698.521173] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25aa3e8f-013d-4e35-addc-3d9537ebd75b with Priority: HIGHEST for action security_group_rules [ 698.521173] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-25aa3e8f-013d-4e35-addc-3d9537ebd75b taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.521173] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-25aa3e8f-013d-4e35-addc-3d9537ebd75b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.521532] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-25aa3e8f-013d-4e35-addc-3d9537ebd75b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.521532] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-25aa3e8f-013d-4e35-addc-3d9537ebd75b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.521872] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('25aa3e8f-013d-4e35-addc-3d9537ebd75b',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.599026] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock network-23 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.599332] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "network-23" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.599538] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "network-23" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.599911] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "network-23" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.600240] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.600495] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.600912] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.600912] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.601046] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.601295] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 698.602426] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 698.602426] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 698.602426] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 698.602426] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 698.602426] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 698.602426] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 698.624811] env[67094]: INFO networking_nsxv3.common.synchronization [None req-4d7d510f-37a2-4e95-bd25-db8bd96a142c tempest-MigrationsAdminTest-1501090521 tempest-MigrationsAdminTest-1501090521-project-member] Enqueued Resource ID: 25aa3e8f-013d-4e35-addc-3d9537ebd75b with Priority: HIGHEST for action security_group_rules [ 698.625947] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 698.626100] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 698.626234] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 698.626429] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "network-23" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.626697] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock port-18cd84cc-bab8-46f4-a7ec-c1ed72317c0a taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.626938] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "port-18cd84cc-bab8-46f4-a7ec-c1ed72317c0a" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.626969] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "port-18cd84cc-bab8-46f4-a7ec-c1ed72317c0a" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.627311] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "port-18cd84cc-bab8-46f4-a7ec-c1ed72317c0a" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.627443] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18cd84cc-bab8-46f4-a7ec-c1ed72317c0a',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 698.628836] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25aa3e8f-013d-4e35-addc-3d9537ebd75b with Priority: HIGHEST for action security_group_rules [ 698.629352] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-25aa3e8f-013d-4e35-addc-3d9537ebd75b taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.629352] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-25aa3e8f-013d-4e35-addc-3d9537ebd75b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.631841] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.631968] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.632051] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.632222] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.632310] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.632504] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 698.632598] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 698.632661] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 698.632815] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 698.632892] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.632984] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e314269-1025-4c1f-b42e-8acab2134cbb already deleted. [ 698.633077] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e314269-1025-4c1f-b42e-8acab2134cbb" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 698.834276] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eb77eddf-2e1d-485c-bfe8-67d4c174dc73',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.024023] env[67094]: INFO networking_nsxv3.common.synchronization [None req-42c7f19a-523f-4051-82a8-800b921d8aec None None] Enqueued Resource ID: 6b613037-c88f-4322-9b3b-ab3f2ff479c9 with Priority: HIGHEST for action port [ 699.025152] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b613037-c88f-4322-9b3b-ab3f2ff479c9 with Priority: HIGHEST for action port [ 699.026868] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-6b613037-c88f-4322-9b3b-ab3f2ff479c9 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.027049] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6b613037-c88f-4322-9b3b-ab3f2ff479c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.027376] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6b613037-c88f-4322-9b3b-ab3f2ff479c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.027547] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6b613037-c88f-4322-9b3b-ab3f2ff479c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.027629] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6b613037-c88f-4322-9b3b-ab3f2ff479c9',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.055249] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.055249] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.055249] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.055249] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.055249] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.055249] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 25aa3e8f-013d-4e35-addc-3d9537ebd75b already deleted. [ 699.055249] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-25aa3e8f-013d-4e35-addc-3d9537ebd75b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.056170] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-25aa3e8f-013d-4e35-addc-3d9537ebd75b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.056619] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-25aa3e8f-013d-4e35-addc-3d9537ebd75b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.057281] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('25aa3e8f-013d-4e35-addc-3d9537ebd75b',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.130581] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.131052] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.131052] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.131052] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.131782] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.131782] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Segment Port 18cd84cc-bab8-46f4-a7ec-c1ed72317c0a not found, creating... [ 699.131782] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.131782] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.131921] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.132259] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.132414] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.132739] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.132898] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.133036] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.133297] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.133437] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.133571] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Resource: SegmentPort with ID: 18cd84cc-bab8-46f4-a7ec-c1ed72317c0a is going to be created. [ 699.161771] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.162049] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.162188] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.162486] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.162758] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.162989] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "port-18cd84cc-bab8-46f4-a7ec-c1ed72317c0a" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.336664] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eb77eddf-2e1d-485c-bfe8-67d4c174dc73: rpc.has_security_group_logging(os_id): False [ 699.356604] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.356775] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.356816] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.357053] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.357151] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.357614] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.357760] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.357801] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.357979] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.358079] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.358256] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eb77eddf-2e1d-485c-bfe8-67d4c174dc73 is going to be created. [ 699.436035] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.436035] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.436447] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.436569] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.436786] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.449676] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eb77eddf-2e1d-485c-bfe8-67d4c174dc73 in Status: IN_PROGRESS for 2s [ 699.531097] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6b613037-c88f-4322-9b3b-ab3f2ff479c9 [ 699.531097] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.531097] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.531097] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.531097] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.531415] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.531415] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6b613037-c88f-4322-9b3b-ab3f2ff479c9 already deleted. [ 699.531415] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6b613037-c88f-4322-9b3b-ab3f2ff479c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.585346] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.585486] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.585537] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.585758] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.585863] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.586468] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 25aa3e8f-013d-4e35-addc-3d9537ebd75b already deleted. [ 699.586468] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-25aa3e8f-013d-4e35-addc-3d9537ebd75b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.924141] env[67094]: INFO networking_nsxv3.common.synchronization [req-6f9c5590-94b1-46ff-b58c-3b34d8057268 req-941aa6f9-f97c-408e-864b-eae5f230b21b service nova] Enqueued Resource ID: 0e314269-1025-4c1f-b42e-8acab2134cbb with Priority: HIGHEST for action security_group_rules [ 699.924141] env[67094]: INFO networking_nsxv3.common.synchronization [req-6f9c5590-94b1-46ff-b58c-3b34d8057268 req-941aa6f9-f97c-408e-864b-eae5f230b21b service nova] Enqueued Resource ID: 0e314269-1025-4c1f-b42e-8acab2134cbb with Priority: HIGHEST for action security_group_members [ 699.924341] env[67094]: INFO networking_nsxv3.common.synchronization [req-6f9c5590-94b1-46ff-b58c-3b34d8057268 req-941aa6f9-f97c-408e-864b-eae5f230b21b service nova] Enqueued Resource ID: 18cd84cc-bab8-46f4-a7ec-c1ed72317c0a with Priority: HIGHEST for action port [ 699.928198] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e314269-1025-4c1f-b42e-8acab2134cbb with Priority: HIGHEST for action security_group_rules [ 699.928471] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e314269-1025-4c1f-b42e-8acab2134cbb with Priority: HIGHEST for action security_group_members [ 699.928691] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18cd84cc-bab8-46f4-a7ec-c1ed72317c0a with Priority: HIGHEST for action port [ 699.929772] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0e314269-1025-4c1f-b42e-8acab2134cbb taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.930115] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0e314269-1025-4c1f-b42e-8acab2134cbb" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.930176] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0e314269-1025-4c1f-b42e-8acab2134cbb" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.930521] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0e314269-1025-4c1f-b42e-8acab2134cbb" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.930694] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0e314269-1025-4c1f-b42e-8acab2134cbb',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.932162] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e314269-1025-4c1f-b42e-8acab2134cbb taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.932365] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e314269-1025-4c1f-b42e-8acab2134cbb" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.933963] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e314269-1025-4c1f-b42e-8acab2134cbb" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.933963] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e314269-1025-4c1f-b42e-8acab2134cbb" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.933963] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.933963] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.934184] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.934466] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.934604] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 699.934751] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e314269-1025-4c1f-b42e-8acab2134cbb',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 699.936230] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-18cd84cc-bab8-46f4-a7ec-c1ed72317c0a taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 699.936819] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-18cd84cc-bab8-46f4-a7ec-c1ed72317c0a" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 699.936819] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-18cd84cc-bab8-46f4-a7ec-c1ed72317c0a" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 699.936819] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-18cd84cc-bab8-46f4-a7ec-c1ed72317c0a" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 699.936978] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18cd84cc-bab8-46f4-a7ec-c1ed72317c0a',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.439014] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0e314269-1025-4c1f-b42e-8acab2134cbb',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.441035] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e314269-1025-4c1f-b42e-8acab2134cbb taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.441035] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e314269-1025-4c1f-b42e-8acab2134cbb" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.441335] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 18cd84cc-bab8-46f4-a7ec-c1ed72317c0a with status ACTIVE [ 700.441401] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.442569] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.442569] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.442569] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.442569] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.442569] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.442569] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.442569] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.442569] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.442569] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.442569] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.443111] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.443397] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.443671] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.443912] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.444153] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 18cd84cc-bab8-46f4-a7ec-c1ed72317c0a is going to be updated. [ 700.475258] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.475258] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.475258] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.475420] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.475470] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.475643] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-18cd84cc-bab8-46f4-a7ec-c1ed72317c0a" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.483023] env[67094]: INFO networking_nsxv3.common.synchronization [req-df24deb4-0ef8-4b85-a32f-00f391b0321c req-9e9034fc-3dd8-452e-9ed4-f2a90d294272 tempest-ImagesOneServerTestJSON-1626915787 tempest-ImagesOneServerTestJSON-1626915787-project-member] Enqueued Resource ID: 0d0028b4-3629-4ade-8832-b0fbfb48d140 with Priority: HIGHEST for action security_group_members [ 700.483574] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0d0028b4-3629-4ade-8832-b0fbfb48d140 with Priority: HIGHEST for action security_group_members [ 700.483927] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0d0028b4-3629-4ade-8832-b0fbfb48d140 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.484079] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0d0028b4-3629-4ade-8832-b0fbfb48d140" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.484131] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0d0028b4-3629-4ade-8832-b0fbfb48d140" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.484320] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0d0028b4-3629-4ade-8832-b0fbfb48d140" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.484529] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.484601] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.484694] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.484763] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.484860] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.484932] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0d0028b4-3629-4ade-8832-b0fbfb48d140',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.560554] env[67094]: INFO networking_nsxv3.common.synchronization [req-114b8752-d4ff-42c1-9c3f-831bacaa99c9 req-a77fb561-d91c-4507-8e7d-e9a7870d6da6 tempest-DeleteServersAdminTestJSON-1006034417 tempest-DeleteServersAdminTestJSON-1006034417-project-member] Enqueued Resource ID: 34103f55-eb7e-4602-9672-09596df7eaa4 with Priority: HIGHEST for action security_group_members [ 700.560554] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34103f55-eb7e-4602-9672-09596df7eaa4 with Priority: HIGHEST for action security_group_members [ 700.560554] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-34103f55-eb7e-4602-9672-09596df7eaa4 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.560805] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34103f55-eb7e-4602-9672-09596df7eaa4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.560805] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34103f55-eb7e-4602-9672-09596df7eaa4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.560883] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34103f55-eb7e-4602-9672-09596df7eaa4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.564129] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.564129] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.564129] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.564129] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.564129] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.564129] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34103f55-eb7e-4602-9672-09596df7eaa4',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.700689] env[67094]: INFO networking_nsxv3.common.synchronization [req-8b70ab86-ec81-4609-bbd1-f3dd82f5c72c req-0685ba47-e379-4c40-ab64-a4ea0eafbd3b tempest-ServerDiagnosticsTest-1342523960 tempest-ServerDiagnosticsTest-1342523960-project-member] Enqueued Resource ID: 52851555-797a-47ba-b408-d4557f3f4ec2 with Priority: HIGHEST for action security_group_members [ 700.701268] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52851555-797a-47ba-b408-d4557f3f4ec2 with Priority: HIGHEST for action security_group_members [ 700.701623] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-52851555-797a-47ba-b408-d4557f3f4ec2 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.701778] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-52851555-797a-47ba-b408-d4557f3f4ec2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.701778] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-52851555-797a-47ba-b408-d4557f3f4ec2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.702523] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-52851555-797a-47ba-b408-d4557f3f4ec2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.704794] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.704794] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.704794] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.704794] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.704794] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.704794] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('52851555-797a-47ba-b408-d4557f3f4ec2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.946344] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0e314269-1025-4c1f-b42e-8acab2134cbb',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 700.988141] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.988319] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.988546] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.988847] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.989080] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.989407] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 700.989535] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 700.989591] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 700.989994] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 700.989994] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 700.990116] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d0028b4-3629-4ade-8832-b0fbfb48d140 is going to be updated. [ 701.029360] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.029848] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.029848] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.029848] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.030043] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.046598] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d0028b4-3629-4ade-8832-b0fbfb48d140 in Status: IN_PROGRESS for 2s [ 701.065865] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.066982] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.066982] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.066982] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.066982] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.066982] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.066982] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.066982] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.066982] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.067267] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.067267] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34103f55-eb7e-4602-9672-09596df7eaa4 is going to be updated. [ 701.099166] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.103298] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.103298] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.103298] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.103298] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.119133] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34103f55-eb7e-4602-9672-09596df7eaa4 in Status: IN_PROGRESS for 2s [ 701.206439] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.206596] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.206722] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.206988] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.207665] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.207665] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.207665] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.207665] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.207931] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.207931] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.207931] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52851555-797a-47ba-b408-d4557f3f4ec2 is going to be updated. [ 701.257944] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.258129] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.258185] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.258470] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.258657] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.269993] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52851555-797a-47ba-b408-d4557f3f4ec2 in Status: IN_PROGRESS for 2s [ 701.452054] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.452380] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.452380] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.452658] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.452658] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.452771] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e314269-1025-4c1f-b42e-8acab2134cbb is going to be created. [ 701.465140] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eb77eddf-2e1d-485c-bfe8-67d4c174dc73 in Status: SUCCESS [ 701.465460] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eb77eddf-2e1d-485c-bfe8-67d4c174dc73" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.480597] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 701.480682] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 701.480752] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 701.480991] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 701.481615] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 701.495298] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e314269-1025-4c1f-b42e-8acab2134cbb in Status: UNINITIALIZED for 2s [ 703.062435] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0d0028b4-3629-4ade-8832-b0fbfb48d140 in Status: SUCCESS [ 703.062847] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0d0028b4-3629-4ade-8832-b0fbfb48d140 deletion is rescheduled due to dependency. [ 703.062847] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0d0028b4-3629-4ade-8832-b0fbfb48d140" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.130028] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34103f55-eb7e-4602-9672-09596df7eaa4 in Status: SUCCESS [ 703.130237] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34103f55-eb7e-4602-9672-09596df7eaa4 deletion is rescheduled due to dependency. [ 703.130335] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34103f55-eb7e-4602-9672-09596df7eaa4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.212440] env[67094]: INFO networking_nsxv3.common.synchronization [req-70c7c046-8ca9-4060-b9b0-ea5a4007e6d7 req-54252593-bbac-4950-986c-8126edefcbfa tempest-FloatingIPsAssociationTestJSON-2123953573 tempest-FloatingIPsAssociationTestJSON-2123953573-project-member] Enqueued Resource ID: 79476966-6948-4fb4-811c-c9f8cee63da2 with Priority: HIGHEST for action security_group_members [ 703.214189] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79476966-6948-4fb4-811c-c9f8cee63da2 with Priority: HIGHEST for action security_group_members [ 703.214189] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-79476966-6948-4fb4-811c-c9f8cee63da2 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.214327] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.214327] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.214570] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.214725] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.214827] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.214892] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.217652] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.217652] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.217652] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('79476966-6948-4fb4-811c-c9f8cee63da2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.281714] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 52851555-797a-47ba-b408-d4557f3f4ec2 in Status: SUCCESS [ 703.281714] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 52851555-797a-47ba-b408-d4557f3f4ec2 deletion is rescheduled due to dependency. [ 703.281714] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-52851555-797a-47ba-b408-d4557f3f4ec2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.505889] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e314269-1025-4c1f-b42e-8acab2134cbb in Status: SUCCESS [ 703.506121] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e314269-1025-4c1f-b42e-8acab2134cbb" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.507503] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e314269-1025-4c1f-b42e-8acab2134cbb" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.507503] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e314269-1025-4c1f-b42e-8acab2134cbb" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.507503] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.507503] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.507503] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.507838] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.507838] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.507838] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e314269-1025-4c1f-b42e-8acab2134cbb" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.507838] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0e314269-1025-4c1f-b42e-8acab2134cbb',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.681587] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock network-844 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.681899] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "network-844" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.682123] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "network-844" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.682604] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "network-844" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.683012] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.683259] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.683466] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.683791] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.684024] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.684338] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 703.684535] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 703.684726] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 703.684904] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 703.685104] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 703.685577] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 703.685801] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 703.706202] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 703.706467] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 703.706681] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 703.706946] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "network-844" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.707425] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock port-d6b904b3-064a-4cf1-9631-7a031c062401 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.707687] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "port-d6b904b3-064a-4cf1-9631-7a031c062401" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.707878] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "port-d6b904b3-064a-4cf1-9631-7a031c062401" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.708475] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "port-d6b904b3-064a-4cf1-9631-7a031c062401" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.708697] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6b904b3-064a-4cf1-9631-7a031c062401',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 703.718829] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.719138] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.719138] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.719425] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.719561] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.719846] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 703.720055] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 703.720172] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 703.720403] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 703.720537] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 703.720668] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 79476966-6948-4fb4-811c-c9f8cee63da2 already deleted. [ 703.720798] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.010232] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e314269-1025-4c1f-b42e-8acab2134cbb taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.010402] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e314269-1025-4c1f-b42e-8acab2134cbb" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.010502] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e314269-1025-4c1f-b42e-8acab2134cbb" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.010802] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e314269-1025-4c1f-b42e-8acab2134cbb" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.011059] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.011220] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.011327] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.011558] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.011699] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.011855] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e314269-1025-4c1f-b42e-8acab2134cbb" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.012105] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e314269-1025-4c1f-b42e-8acab2134cbb taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.012261] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e314269-1025-4c1f-b42e-8acab2134cbb" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.012366] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e314269-1025-4c1f-b42e-8acab2134cbb" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.012626] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e314269-1025-4c1f-b42e-8acab2134cbb" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.012804] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.012955] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.013082] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.013305] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.013437] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.013579] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e314269-1025-4c1f-b42e-8acab2134cbb" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.013718] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0e314269-1025-4c1f-b42e-8acab2134cbb',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.216024] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.216024] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.216024] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.216024] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.216024] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.216024] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Segment Port d6b904b3-064a-4cf1-9631-7a031c062401 not found, creating... [ 704.216024] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.216024] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.216024] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.216024] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.216024] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.216790] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.216790] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.216790] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.216790] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.216790] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.216790] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Resource: SegmentPort with ID: d6b904b3-064a-4cf1-9631-7a031c062401 is going to be created. [ 704.240125] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.240125] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.240125] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.240125] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.240125] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.240125] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "port-d6b904b3-064a-4cf1-9631-7a031c062401" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.516400] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0e314269-1025-4c1f-b42e-8acab2134cbb: rpc.has_security_group_logging(os_id): False [ 704.535474] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.535647] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.535895] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.536102] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.536337] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.536499] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.536735] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.536735] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.536848] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.536848] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.537170] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.537170] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.537170] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.537446] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.537446] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.537645] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.537645] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.537718] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.537828] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.537901] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.537983] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0e314269-1025-4c1f-b42e-8acab2134cbb is going to be created. [ 704.600698] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.601066] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.601066] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.601175] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.601387] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.617616] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0e314269-1025-4c1f-b42e-8acab2134cbb in Status: IN_PROGRESS for 2s [ 704.964205] env[67094]: INFO networking_nsxv3.common.synchronization [req-70c7c046-8ca9-4060-b9b0-ea5a4007e6d7 req-c8b1eae9-6636-4622-b5fd-f909e9f01933 service nova] Enqueued Resource ID: 79476966-6948-4fb4-811c-c9f8cee63da2 with Priority: HIGHEST for action security_group_rules [ 704.964777] env[67094]: INFO networking_nsxv3.common.synchronization [req-70c7c046-8ca9-4060-b9b0-ea5a4007e6d7 req-c8b1eae9-6636-4622-b5fd-f909e9f01933 service nova] Enqueued Resource ID: 79476966-6948-4fb4-811c-c9f8cee63da2 with Priority: HIGHEST for action security_group_members [ 704.965209] env[67094]: INFO networking_nsxv3.common.synchronization [req-70c7c046-8ca9-4060-b9b0-ea5a4007e6d7 req-c8b1eae9-6636-4622-b5fd-f909e9f01933 service nova] Enqueued Resource ID: d6b904b3-064a-4cf1-9631-7a031c062401 with Priority: HIGHEST for action port [ 704.965989] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79476966-6948-4fb4-811c-c9f8cee63da2 with Priority: HIGHEST for action security_group_rules [ 704.966228] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79476966-6948-4fb4-811c-c9f8cee63da2 with Priority: HIGHEST for action security_group_members [ 704.966463] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6b904b3-064a-4cf1-9631-7a031c062401 with Priority: HIGHEST for action port [ 704.966970] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-79476966-6948-4fb4-811c-c9f8cee63da2 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.967200] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.967472] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.967918] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.967918] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('79476966-6948-4fb4-811c-c9f8cee63da2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.969598] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-79476966-6948-4fb4-811c-c9f8cee63da2 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.970972] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.970972] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.970972] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.970972] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.970972] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.970972] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.970972] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.970972] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 704.970972] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('79476966-6948-4fb4-811c-c9f8cee63da2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 704.972031] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-d6b904b3-064a-4cf1-9631-7a031c062401 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 704.972151] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d6b904b3-064a-4cf1-9631-7a031c062401" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 704.972265] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d6b904b3-064a-4cf1-9631-7a031c062401" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 704.972504] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d6b904b3-064a-4cf1-9631-7a031c062401" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 704.972651] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6b904b3-064a-4cf1-9631-7a031c062401',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.280896] env[67094]: INFO networking_nsxv3.common.synchronization [None req-55d0f66d-cd13-4af5-b15f-a7ea6ab4d167 None None] Enqueued Resource ID: 2c3224de-4952-420a-a9f4-c7876b9f9827 with Priority: HIGHEST for action port [ 705.281551] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2c3224de-4952-420a-a9f4-c7876b9f9827 with Priority: HIGHEST for action port [ 705.281906] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-2c3224de-4952-420a-a9f4-c7876b9f9827 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.283585] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2c3224de-4952-420a-a9f4-c7876b9f9827" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.283585] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2c3224de-4952-420a-a9f4-c7876b9f9827" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.283851] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2c3224de-4952-420a-a9f4-c7876b9f9827" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.284026] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2c3224de-4952-420a-a9f4-c7876b9f9827',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.476040] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('79476966-6948-4fb4-811c-c9f8cee63da2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 705.476040] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-79476966-6948-4fb4-811c-c9f8cee63da2 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.476040] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.476040] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d6b904b3-064a-4cf1-9631-7a031c062401 with status ACTIVE [ 705.476343] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.476343] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.477144] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.477144] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.477144] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.477144] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.477144] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.477144] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.477440] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.478374] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.478374] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.478374] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.478374] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.478374] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.478374] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.478374] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d6b904b3-064a-4cf1-9631-7a031c062401 is going to be updated. [ 705.504030] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.504030] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.504030] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.504030] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.504637] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.504908] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d6b904b3-064a-4cf1-9631-7a031c062401" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.787756] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2c3224de-4952-420a-a9f4-c7876b9f9827 [ 705.787756] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 705.787756] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 705.787756] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 705.789466] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 705.789575] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.789681] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2c3224de-4952-420a-a9f4-c7876b9f9827 already deleted. [ 705.791459] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2c3224de-4952-420a-a9f4-c7876b9f9827" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 705.980735] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('79476966-6948-4fb4-811c-c9f8cee63da2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 706.484646] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.485530] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.488292] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.488292] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.488292] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.488292] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 79476966-6948-4fb4-811c-c9f8cee63da2 is going to be created. [ 706.530245] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 706.530245] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 706.530245] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 706.530245] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 706.530245] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 706.546337] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79476966-6948-4fb4-811c-c9f8cee63da2 in Status: UNINITIALIZED for 2s [ 706.637179] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0e314269-1025-4c1f-b42e-8acab2134cbb in Status: SUCCESS [ 706.637670] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0e314269-1025-4c1f-b42e-8acab2134cbb" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 707.701689] env[67094]: INFO networking_nsxv3.common.synchronization [None req-6bf8cdff-f2c3-4cc4-a49e-3870b3711874 None None] Enqueued Resource ID: fe4bd600-e5dd-492c-b100-14a99aa48793 with Priority: HIGHEST for action port [ 707.702449] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe4bd600-e5dd-492c-b100-14a99aa48793 with Priority: HIGHEST for action port [ 707.702780] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-fe4bd600-e5dd-492c-b100-14a99aa48793 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 707.702936] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fe4bd600-e5dd-492c-b100-14a99aa48793" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 707.702996] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fe4bd600-e5dd-492c-b100-14a99aa48793" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 707.703229] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fe4bd600-e5dd-492c-b100-14a99aa48793" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 707.703330] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe4bd600-e5dd-492c-b100-14a99aa48793',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.208716] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fe4bd600-e5dd-492c-b100-14a99aa48793 [ 708.208797] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.208923] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.209142] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.209254] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.209422] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.209502] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fe4bd600-e5dd-492c-b100-14a99aa48793 already deleted. [ 708.209594] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fe4bd600-e5dd-492c-b100-14a99aa48793" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.451225] env[67094]: INFO networking_nsxv3.common.synchronization [req-86285921-54a5-4df8-a7d4-25b50d64b907 req-25286fea-943f-4271-835f-424bf44d6df1 tempest-ImagesTestJSON-2097058733 tempest-ImagesTestJSON-2097058733-project-member] Enqueued Resource ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa with Priority: HIGHEST for action security_group_members [ 708.451841] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa with Priority: HIGHEST for action security_group_members [ 708.456310] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-84918628-8f8e-4d25-9c0f-17cccb58ebfa taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.456658] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.459260] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.459260] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.459260] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.459260] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.459260] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.459260] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.459260] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.459260] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('84918628-8f8e-4d25-9c0f-17cccb58ebfa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.559614] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79476966-6948-4fb4-811c-c9f8cee63da2 in Status: SUCCESS [ 708.559614] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.559614] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.559614] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.559614] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.559614] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.559614] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.559614] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.559614] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.559614] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.559614] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('79476966-6948-4fb4-811c-c9f8cee63da2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 708.961233] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.961754] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.961754] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.961754] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.961944] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.962113] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.962238] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.962298] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.962485] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.962605] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 708.962705] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa is going to be updated. [ 708.993933] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 708.994165] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 708.994165] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 708.994407] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 708.994559] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.005212] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa in Status: IN_PROGRESS for 2s [ 709.043391] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock network-842 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.043611] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "network-842" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.043956] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "network-842" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.044520] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "network-842" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.045108] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.045481] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.045783] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.046283] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.046618] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.047057] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 709.047355] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 709.047633] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 709.047880] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 709.048125] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 709.048351] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 709.048627] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 709.062130] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-79476966-6948-4fb4-811c-c9f8cee63da2 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.062451] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.062647] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.062961] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.063270] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.063467] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.063608] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.063899] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.064143] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.064335] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.064638] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-79476966-6948-4fb4-811c-c9f8cee63da2 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.064847] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.064994] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.065616] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.065616] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.065857] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.065981] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.066393] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.066393] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.066556] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.066941] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('79476966-6948-4fb4-811c-c9f8cee63da2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.069563] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 709.069824] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 709.070143] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 709.070462] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "network-842" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.070756] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock port-17e50af4-7e53-46ed-a270-a09c9bb04b37 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.071043] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "port-17e50af4-7e53-46ed-a270-a09c9bb04b37" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.071304] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "port-17e50af4-7e53-46ed-a270-a09c9bb04b37" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.071788] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "port-17e50af4-7e53-46ed-a270-a09c9bb04b37" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.072052] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('17e50af4-7e53-46ed-a270-a09c9bb04b37',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 709.574450] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 79476966-6948-4fb4-811c-c9f8cee63da2: rpc.has_security_group_logging(os_id): False [ 709.576239] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.576460] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.576618] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.576842] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.577759] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.578437] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Segment Port 17e50af4-7e53-46ed-a270-a09c9bb04b37 not found, creating... [ 709.578752] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.578916] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.579043] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.579270] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.579405] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.579680] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.579855] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.580567] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.580924] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.581079] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.581220] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Resource: SegmentPort with ID: 17e50af4-7e53-46ed-a270-a09c9bb04b37 is going to be created. [ 709.600140] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.600340] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.600340] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.601021] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.601021] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.601021] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.601021] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.601021] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.601506] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.601506] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.601506] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.601663] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.601663] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.602216] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.602216] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.603116] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.603335] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.603335] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.603532] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.603632] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.603740] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 79476966-6948-4fb4-811c-c9f8cee63da2 is going to be created. [ 709.608307] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.608467] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.609616] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.609936] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.610193] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.610430] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "port-17e50af4-7e53-46ed-a270-a09c9bb04b37" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.692035] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.692671] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.692893] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.693211] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.693416] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.708265] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 79476966-6948-4fb4-811c-c9f8cee63da2 in Status: IN_PROGRESS for 2s [ 709.895972] env[67094]: INFO networking_nsxv3.common.synchronization [req-e5552094-da67-4712-813f-b97a5038fae3 req-b3146f23-0755-4719-9c97-ce266614b1c2 tempest-ServersTestJSON-1070791530 tempest-ServersTestJSON-1070791530-project-member] Enqueued Resource ID: c0881101-1be1-4dbf-ac18-2d54a689202c with Priority: HIGHEST for action security_group_members [ 709.899185] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0881101-1be1-4dbf-ac18-2d54a689202c with Priority: HIGHEST for action security_group_members [ 709.899185] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0881101-1be1-4dbf-ac18-2d54a689202c taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.899185] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.899185] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.899185] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.899185] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 709.899185] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 709.899185] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 709.899185] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 709.899185] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 709.899185] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.401023] env[67094]: INFO networking_nsxv3.common.synchronization [req-86285921-54a5-4df8-a7d4-25b50d64b907 req-64d0118a-ad71-46b9-88c8-706a0bb595b0 service nova] Enqueued Resource ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa with Priority: HIGHEST for action security_group_rules [ 710.401023] env[67094]: INFO networking_nsxv3.common.synchronization [req-86285921-54a5-4df8-a7d4-25b50d64b907 req-64d0118a-ad71-46b9-88c8-706a0bb595b0 service nova] Enqueued Resource ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa with Priority: HIGHEST for action security_group_members [ 710.401023] env[67094]: INFO networking_nsxv3.common.synchronization [req-86285921-54a5-4df8-a7d4-25b50d64b907 req-64d0118a-ad71-46b9-88c8-706a0bb595b0 service nova] Enqueued Resource ID: 17e50af4-7e53-46ed-a270-a09c9bb04b37 with Priority: HIGHEST for action port [ 710.401753] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa with Priority: HIGHEST for action security_group_rules [ 710.402125] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa with Priority: HIGHEST for action security_group_members [ 710.402543] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17e50af4-7e53-46ed-a270-a09c9bb04b37 with Priority: HIGHEST for action port [ 710.403114] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.404556] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-84918628-8f8e-4d25-9c0f-17cccb58ebfa taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.404981] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.405219] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.405632] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.405846] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('84918628-8f8e-4d25-9c0f-17cccb58ebfa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.410290] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-84918628-8f8e-4d25-9c0f-17cccb58ebfa taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.410290] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.410290] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-17e50af4-7e53-46ed-a270-a09c9bb04b37 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.410290] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-17e50af4-7e53-46ed-a270-a09c9bb04b37" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.410290] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-17e50af4-7e53-46ed-a270-a09c9bb04b37" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.410290] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-17e50af4-7e53-46ed-a270-a09c9bb04b37" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.410290] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('17e50af4-7e53-46ed-a270-a09c9bb04b37',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.910493] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 710.912023] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-84918628-8f8e-4d25-9c0f-17cccb58ebfa taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.912173] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.912519] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 17e50af4-7e53-46ed-a270-a09c9bb04b37 with status ACTIVE [ 710.912701] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.912829] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.912901] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.913149] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.913254] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.913450] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.913564] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.913627] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.913808] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.913893] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.914121] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.914236] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.914368] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.914450] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.914546] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.914665] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 17e50af4-7e53-46ed-a270-a09c9bb04b37 is going to be updated. [ 710.943386] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 710.943386] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 710.943386] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 710.943386] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 710.943386] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 710.943676] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-17e50af4-7e53-46ed-a270-a09c9bb04b37" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.019837] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa in Status: SUCCESS [ 711.020162] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa deletion is rescheduled due to dependency. [ 711.020325] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.020473] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.020688] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.020903] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.021112] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.021112] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.021273] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.021343] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.021460] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('84918628-8f8e-4d25-9c0f-17cccb58ebfa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.414697] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.415068] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.415068] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.415318] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.415427] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.415525] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0881101-1be1-4dbf-ac18-2d54a689202c is going to be updated. [ 711.452613] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.452613] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.452613] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.452613] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.452613] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.464789] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0881101-1be1-4dbf-ac18-2d54a689202c in Status: IN_PROGRESS for 2s [ 711.524629] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('84918628-8f8e-4d25-9c0f-17cccb58ebfa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 711.726493] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 79476966-6948-4fb4-811c-c9f8cee63da2 in Status: SUCCESS [ 711.727813] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.956824] env[67094]: INFO networking_nsxv3.common.synchronization [req-fb80d91f-f04c-4e44-8a5b-229a4051e2db req-05c71520-0ed6-4c35-8328-26f804d08088 tempest-VolumesAssistedSnapshotsTest-1350353743 tempest-VolumesAssistedSnapshotsTest-1350353743-project-member] Enqueued Resource ID: f71d6693-6145-4241-b055-f03e34f73c7f with Priority: HIGHEST for action security_group_members [ 711.957946] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f71d6693-6145-4241-b055-f03e34f73c7f with Priority: HIGHEST for action security_group_members [ 711.958574] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-f71d6693-6145-4241-b055-f03e34f73c7f taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.958574] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f71d6693-6145-4241-b055-f03e34f73c7f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.958574] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f71d6693-6145-4241-b055-f03e34f73c7f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.958727] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f71d6693-6145-4241-b055-f03e34f73c7f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.958995] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 711.959167] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 711.959225] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 711.959368] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 711.959485] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 711.959577] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f71d6693-6145-4241-b055-f03e34f73c7f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.029699] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('84918628-8f8e-4d25-9c0f-17cccb58ebfa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 712.462783] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.462783] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.462783] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.462783] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.462783] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.463384] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.463384] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.463384] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.463384] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.463572] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.463572] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f71d6693-6145-4241-b055-f03e34f73c7f is going to be updated. [ 712.506848] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.507163] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.507487] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.507632] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.508039] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.520612] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f71d6693-6145-4241-b055-f03e34f73c7f in Status: IN_PROGRESS for 2s [ 712.535715] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.535957] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.535957] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.536186] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.536272] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.536374] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa is going to be updated. [ 712.575883] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 712.576112] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 712.576112] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 712.576354] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 712.576514] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 712.606910] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa in Status: IN_PROGRESS for 2s [ 713.354301] env[67094]: INFO networking_nsxv3.common.synchronization [req-b8f8deaf-f82a-4003-82ce-e8e3e7f83e78 req-04c699a8-c683-483a-a651-a11c2c30b1c1 tempest-ListServersNegativeTestJSON-1929385440 tempest-ListServersNegativeTestJSON-1929385440-project-member] Enqueued Resource ID: 90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 with Priority: HIGHEST for action security_group_members [ 713.356286] env[67094]: INFO networking_nsxv3.common.synchronization [req-026fe018-68ba-4222-b388-3539bff38099 req-371a5cd9-4744-4838-bab1-8b6f786f4b4c tempest-ServersAdminNegativeTestJSON-87945101 tempest-ServersAdminNegativeTestJSON-87945101-project-member] Enqueued Resource ID: 75d792df-97d6-4e1a-bf50-631a4a868869 with Priority: HIGHEST for action security_group_members [ 713.356996] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 with Priority: HIGHEST for action security_group_members [ 713.357302] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75d792df-97d6-4e1a-bf50-631a4a868869 with Priority: HIGHEST for action security_group_members [ 713.357765] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.357976] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.358140] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.358663] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.358919] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.359118] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.359259] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.359492] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.359643] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.359814] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.360822] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-75d792df-97d6-4e1a-bf50-631a4a868869 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.360999] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75d792df-97d6-4e1a-bf50-631a4a868869" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.362318] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75d792df-97d6-4e1a-bf50-631a4a868869" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.363074] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75d792df-97d6-4e1a-bf50-631a4a868869" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.363074] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 713.364537] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 713.364537] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 713.364537] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 713.364537] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.364537] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75d792df-97d6-4e1a-bf50-631a4a868869',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.477359] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0881101-1be1-4dbf-ac18-2d54a689202c in Status: SUCCESS [ 713.477864] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 713.870791] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 713.871710] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('75d792df-97d6-4e1a-bf50-631a4a868869',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.100791] env[67094]: INFO networking_nsxv3.common.synchronization [req-5bf625b1-f4d1-494b-8cc5-cdd65be7316f req-f2baf6a0-22ec-491b-a424-eddfb543c1a2 tempest-ListServersNegativeTestJSON-1929385440 tempest-ListServersNegativeTestJSON-1929385440-project-member] Enqueued Resource ID: 90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 with Priority: HIGHEST for action security_group_members [ 714.101025] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 with Priority: HIGHEST for action security_group_members [ 714.101449] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.101561] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.227954] env[67094]: INFO networking_nsxv3.common.synchronization [req-1834d762-f257-4572-987b-a582d59acb74 req-f901ee7f-53d2-4ca1-bb3e-b832641f8087 tempest-ServersWithSpecificFlavorTestJSON-602104183 tempest-ServersWithSpecificFlavorTestJSON-602104183-project-member] Enqueued Resource ID: 60943622-73b5-4dda-ad21-63bf08db617e with Priority: HIGHEST for action security_group_members [ 714.228700] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60943622-73b5-4dda-ad21-63bf08db617e with Priority: HIGHEST for action security_group_members [ 714.228989] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-60943622-73b5-4dda-ad21-63bf08db617e taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.229665] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60943622-73b5-4dda-ad21-63bf08db617e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.229665] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60943622-73b5-4dda-ad21-63bf08db617e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.229879] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60943622-73b5-4dda-ad21-63bf08db617e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.229879] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.229963] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.230009] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.230170] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.230252] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.231576] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60943622-73b5-4dda-ad21-63bf08db617e',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.374478] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.376805] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('75d792df-97d6-4e1a-bf50-631a4a868869',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.540605] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f71d6693-6145-4241-b055-f03e34f73c7f in Status: SUCCESS [ 714.540605] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f71d6693-6145-4241-b055-f03e34f73c7f deletion is rescheduled due to dependency. [ 714.540605] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f71d6693-6145-4241-b055-f03e34f73c7f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.625196] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa in Status: SUCCESS [ 714.625712] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.625996] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.626273] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.626530] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.626708] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.626794] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.626996] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.627136] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.627268] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.627384] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('84918628-8f8e-4d25-9c0f-17cccb58ebfa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 714.732430] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.732664] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.732758] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.733073] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.733241] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.733582] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.733886] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.733886] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.734057] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.734170] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.734288] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60943622-73b5-4dda-ad21-63bf08db617e is going to be updated. [ 714.769600] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.769600] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.769857] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.770137] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.770212] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.782068] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60943622-73b5-4dda-ad21-63bf08db617e in Status: IN_PROGRESS for 2s [ 714.876783] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.876966] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.877065] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.877298] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.877391] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.877544] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 is going to be updated. [ 714.878952] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.879129] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.879198] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.879380] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.879465] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.879557] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75d792df-97d6-4e1a-bf50-631a4a868869 is going to be updated. [ 714.915056] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.915249] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.915249] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.916067] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.916067] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.918448] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 714.918448] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 714.918448] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 714.918448] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 714.918448] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 714.935099] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 in Status: IN_PROGRESS for 2s [ 714.935958] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75d792df-97d6-4e1a-bf50-631a4a868869 in Status: IN_PROGRESS for 2s [ 715.132791] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-84918628-8f8e-4d25-9c0f-17cccb58ebfa taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.133017] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.133252] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.134035] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.134035] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.134244] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.134350] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.134901] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.134901] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.135035] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.135255] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-84918628-8f8e-4d25-9c0f-17cccb58ebfa taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.135429] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.135524] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.135760] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.135967] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.136107] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.136859] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.136859] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.136859] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.136859] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.137130] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('84918628-8f8e-4d25-9c0f-17cccb58ebfa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 715.640056] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 84918628-8f8e-4d25-9c0f-17cccb58ebfa: rpc.has_security_group_logging(os_id): False [ 715.659894] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.660939] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.660939] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.660939] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.660939] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.660939] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.660939] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.660939] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.661250] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.661250] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.661462] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.661462] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.661549] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.661683] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.663511] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.663511] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.663511] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.663511] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.663511] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.663511] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.663511] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa is going to be updated. [ 715.748203] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 715.748412] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 715.748494] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 715.748755] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 715.748916] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 715.764779] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa in Status: IN_PROGRESS for 2s [ 716.804181] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60943622-73b5-4dda-ad21-63bf08db617e in Status: SUCCESS [ 716.804181] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60943622-73b5-4dda-ad21-63bf08db617e deletion is rescheduled due to dependency. [ 716.804181] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60943622-73b5-4dda-ad21-63bf08db617e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.950177] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75d792df-97d6-4e1a-bf50-631a4a868869 in Status: SUCCESS [ 716.950177] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75d792df-97d6-4e1a-bf50-631a4a868869" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.950599] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 in Status: SUCCESS [ 716.950782] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.951196] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.951319] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.951492] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 716.951772] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 716.951772] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 716.951908] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 716.953344] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 716.953344] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.022045] env[67094]: INFO networking_nsxv3.common.synchronization [None req-a7c03263-d567-45d1-9bb1-de4d8e2f90e4 None None] Enqueued Resource ID: a88fa8f8-f323-4f7e-b948-bbae7a6d53bb with Priority: HIGHEST for action port [ 717.022045] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a88fa8f8-f323-4f7e-b948-bbae7a6d53bb with Priority: HIGHEST for action port [ 717.022045] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-a88fa8f8-f323-4f7e-b948-bbae7a6d53bb taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.022045] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a88fa8f8-f323-4f7e-b948-bbae7a6d53bb" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.022045] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a88fa8f8-f323-4f7e-b948-bbae7a6d53bb" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.023049] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a88fa8f8-f323-4f7e-b948-bbae7a6d53bb" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.023293] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a88fa8f8-f323-4f7e-b948-bbae7a6d53bb',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.455289] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.455949] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.456252] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.458429] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.458429] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.458429] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.458429] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.458429] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.458429] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.458429] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.458429] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 is going to be updated. [ 717.493457] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.493573] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.493669] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.494732] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.494732] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.504250] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 in Status: IN_PROGRESS for 2s [ 717.527810] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port a88fa8f8-f323-4f7e-b948-bbae7a6d53bb [ 717.527810] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.527810] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.527810] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.527810] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.527810] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.527810] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:a88fa8f8-f323-4f7e-b948-bbae7a6d53bb already deleted. [ 717.528156] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a88fa8f8-f323-4f7e-b948-bbae7a6d53bb" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 717.704182] env[67094]: INFO networking_nsxv3.common.synchronization [None req-2d1b2a7c-52c1-4d55-9e06-7ce331cee72e None None] Enqueued Resource ID: 7c7e20d5-6bf0-49a0-985e-f576f391125d with Priority: HIGHEST for action port [ 717.704182] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c7e20d5-6bf0-49a0-985e-f576f391125d with Priority: HIGHEST for action port [ 717.704182] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-7c7e20d5-6bf0-49a0-985e-f576f391125d taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 717.704182] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7c7e20d5-6bf0-49a0-985e-f576f391125d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 717.704641] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7c7e20d5-6bf0-49a0-985e-f576f391125d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 717.705030] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7c7e20d5-6bf0-49a0-985e-f576f391125d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 717.705244] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c7e20d5-6bf0-49a0-985e-f576f391125d',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 717.781799] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa in Status: SUCCESS [ 717.782891] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.208462] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7c7e20d5-6bf0-49a0-985e-f576f391125d [ 718.209989] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 718.209989] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 718.209989] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 718.209989] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 718.209989] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 718.209989] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7c7e20d5-6bf0-49a0-985e-f576f391125d already deleted. [ 718.209989] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7c7e20d5-6bf0-49a0-985e-f576f391125d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.089023] env[67094]: INFO networking_nsxv3.common.synchronization [req-04e140b9-16f0-49d9-bcdf-eb5833fcd9d6 req-9fb153cb-9df3-4c46-994e-1704f01fb4aa tempest-ServersTestManualDisk-1900155527 tempest-ServersTestManualDisk-1900155527-project-member] Enqueued Resource ID: 6b8aa78a-ad3e-4d9d-94d1-2156bff23176 with Priority: HIGHEST for action security_group_members [ 719.091998] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b8aa78a-ad3e-4d9d-94d1-2156bff23176 with Priority: HIGHEST for action security_group_members [ 719.091998] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b8aa78a-ad3e-4d9d-94d1-2156bff23176 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.091998] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b8aa78a-ad3e-4d9d-94d1-2156bff23176" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.091998] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b8aa78a-ad3e-4d9d-94d1-2156bff23176" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.091998] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b8aa78a-ad3e-4d9d-94d1-2156bff23176" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.091998] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.091998] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.091998] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.091998] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.091998] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.091998] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b8aa78a-ad3e-4d9d-94d1-2156bff23176',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.516324] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 in Status: SUCCESS [ 719.516596] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 deletion is rescheduled due to dependency. [ 719.517947] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.529512] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock network-360 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.529707] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "network-360" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.529850] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "network-360" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.530185] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "network-360" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.530439] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.530576] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.530682] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.530883] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.531231] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.531511] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 719.531677] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 719.532550] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 719.532724] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 719.532911] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 719.533068] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 719.536290] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 719.556381] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 719.556548] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 719.556696] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 719.556866] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "network-360" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.557258] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock port-8c0b23bf-b327-44a5-901a-3552f717e7c1 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.557426] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "port-8c0b23bf-b327-44a5-901a-3552f717e7c1" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.557550] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "port-8c0b23bf-b327-44a5-901a-3552f717e7c1" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.557864] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "port-8c0b23bf-b327-44a5-901a-3552f717e7c1" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.557989] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c0b23bf-b327-44a5-901a-3552f717e7c1',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 719.594783] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.598554] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.598554] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.598554] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.598554] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.598554] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 719.598554] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 719.598554] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 719.598554] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 719.598554] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 719.598554] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b8aa78a-ad3e-4d9d-94d1-2156bff23176 already deleted. [ 719.598554] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b8aa78a-ad3e-4d9d-94d1-2156bff23176" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.061562] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.061729] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.061849] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.062151] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.062298] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.062445] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Segment Port 8c0b23bf-b327-44a5-901a-3552f717e7c1 not found, creating... [ 720.062730] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.062933] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.063070] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.063379] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.063540] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.063859] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.063993] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.064117] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.064325] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.064451] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.064588] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Resource: SegmentPort with ID: 8c0b23bf-b327-44a5-901a-3552f717e7c1 is going to be created. [ 720.091417] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.091635] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.091757] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.091984] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.092307] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.092556] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "port-8c0b23bf-b327-44a5-901a-3552f717e7c1" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.370888] env[67094]: INFO networking_nsxv3.common.synchronization [None req-634893a2-5192-49a6-b2ce-a78bcde915ce None None] Enqueued Resource ID: fa577379-13ec-4ee5-81c6-ebe4aa968700 with Priority: HIGHEST for action port [ 720.371467] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa577379-13ec-4ee5-81c6-ebe4aa968700 with Priority: HIGHEST for action port [ 720.371732] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-fa577379-13ec-4ee5-81c6-ebe4aa968700 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.371935] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fa577379-13ec-4ee5-81c6-ebe4aa968700" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.371935] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fa577379-13ec-4ee5-81c6-ebe4aa968700" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.374607] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fa577379-13ec-4ee5-81c6-ebe4aa968700" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.374607] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa577379-13ec-4ee5-81c6-ebe4aa968700',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.801714] env[67094]: INFO networking_nsxv3.common.synchronization [req-04e140b9-16f0-49d9-bcdf-eb5833fcd9d6 req-c8749cb4-6a5a-4c1c-b760-630009200c99 service nova] Enqueued Resource ID: 6b8aa78a-ad3e-4d9d-94d1-2156bff23176 with Priority: HIGHEST for action security_group_rules [ 720.801714] env[67094]: INFO networking_nsxv3.common.synchronization [req-04e140b9-16f0-49d9-bcdf-eb5833fcd9d6 req-c8749cb4-6a5a-4c1c-b760-630009200c99 service nova] Enqueued Resource ID: 6b8aa78a-ad3e-4d9d-94d1-2156bff23176 with Priority: HIGHEST for action security_group_members [ 720.801714] env[67094]: INFO networking_nsxv3.common.synchronization [req-04e140b9-16f0-49d9-bcdf-eb5833fcd9d6 req-c8749cb4-6a5a-4c1c-b760-630009200c99 service nova] Enqueued Resource ID: 8c0b23bf-b327-44a5-901a-3552f717e7c1 with Priority: HIGHEST for action port [ 720.802129] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b8aa78a-ad3e-4d9d-94d1-2156bff23176 with Priority: HIGHEST for action security_group_rules [ 720.802129] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b8aa78a-ad3e-4d9d-94d1-2156bff23176 with Priority: HIGHEST for action security_group_members [ 720.802129] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c0b23bf-b327-44a5-901a-3552f717e7c1 with Priority: HIGHEST for action port [ 720.802667] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b8aa78a-ad3e-4d9d-94d1-2156bff23176 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.802667] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b8aa78a-ad3e-4d9d-94d1-2156bff23176" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.802667] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b8aa78a-ad3e-4d9d-94d1-2156bff23176" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.802667] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b8aa78a-ad3e-4d9d-94d1-2156bff23176" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.802837] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b8aa78a-ad3e-4d9d-94d1-2156bff23176',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.803561] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b8aa78a-ad3e-4d9d-94d1-2156bff23176 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.806776] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b8aa78a-ad3e-4d9d-94d1-2156bff23176" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.806776] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b8aa78a-ad3e-4d9d-94d1-2156bff23176" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.806776] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b8aa78a-ad3e-4d9d-94d1-2156bff23176" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.806776] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.806776] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.806776] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.806776] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.806776] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.806776] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b8aa78a-ad3e-4d9d-94d1-2156bff23176',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.812100] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-8c0b23bf-b327-44a5-901a-3552f717e7c1 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.812234] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8c0b23bf-b327-44a5-901a-3552f717e7c1" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.812320] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8c0b23bf-b327-44a5-901a-3552f717e7c1" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.812494] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8c0b23bf-b327-44a5-901a-3552f717e7c1" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.812579] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c0b23bf-b327-44a5-901a-3552f717e7c1',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 720.875392] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fa577379-13ec-4ee5-81c6-ebe4aa968700 [ 720.877044] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.877044] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.877044] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.877044] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.877044] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.877044] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fa577379-13ec-4ee5-81c6-ebe4aa968700 already deleted. [ 720.877044] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fa577379-13ec-4ee5-81c6-ebe4aa968700" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 720.934510] env[67094]: INFO networking_nsxv3.common.synchronization [None req-9843ff39-8710-4d07-a71a-70cbc52b43f4 None None] Enqueued Resource ID: f4937ccb-a53b-4b7a-a31c-63900b1e39d0 with Priority: HIGHEST for action port [ 720.934810] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f4937ccb-a53b-4b7a-a31c-63900b1e39d0 with Priority: HIGHEST for action port [ 720.939700] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-f4937ccb-a53b-4b7a-a31c-63900b1e39d0 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 720.939890] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f4937ccb-a53b-4b7a-a31c-63900b1e39d0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 720.939977] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f4937ccb-a53b-4b7a-a31c-63900b1e39d0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 720.940423] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f4937ccb-a53b-4b7a-a31c-63900b1e39d0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 720.942305] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f4937ccb-a53b-4b7a-a31c-63900b1e39d0',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.314678] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b8aa78a-ad3e-4d9d-94d1-2156bff23176 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.314678] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b8aa78a-ad3e-4d9d-94d1-2156bff23176" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.314893] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6b8aa78a-ad3e-4d9d-94d1-2156bff23176',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.316163] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8c0b23bf-b327-44a5-901a-3552f717e7c1 with status ACTIVE [ 721.316366] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.316544] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.316604] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.316770] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.316860] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.317041] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.317844] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.317844] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.317844] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.317844] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.317844] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.317844] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.317844] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.318191] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.318897] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.319045] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8c0b23bf-b327-44a5-901a-3552f717e7c1 is going to be updated. [ 721.343279] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.344050] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.344050] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.344050] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.345167] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.345167] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8c0b23bf-b327-44a5-901a-3552f717e7c1" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.442652] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f4937ccb-a53b-4b7a-a31c-63900b1e39d0 [ 721.442924] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.443673] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.443673] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.443673] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.443673] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.443673] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f4937ccb-a53b-4b7a-a31c-63900b1e39d0 already deleted. [ 721.443673] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f4937ccb-a53b-4b7a-a31c-63900b1e39d0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.720904] env[67094]: INFO networking_nsxv3.common.synchronization [req-298ca655-1847-4ac2-a7ae-36dc3a65112a req-28c2b564-0ee1-4930-a2bd-3283d88aa42b tempest-ServersAdminTestJSON-236082081 tempest-ServersAdminTestJSON-236082081-project-member] Enqueued Resource ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f with Priority: HIGHEST for action security_group_members [ 721.721482] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f with Priority: HIGHEST for action security_group_members [ 721.722500] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f2ac94a-4beb-4e79-8490-47989224cf9f taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.722500] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.722602] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.722941] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.722941] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 721.723148] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 721.723209] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 721.723321] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 721.723409] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 721.723556] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f2ac94a-4beb-4e79-8490-47989224cf9f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 721.822811] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6b8aa78a-ad3e-4d9d-94d1-2156bff23176',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.069636] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock network-107 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.070513] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "network-107" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.070513] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "network-107" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.070678] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "network-107" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.071998] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.071998] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.071998] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.071998] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.071998] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.071998] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 722.071998] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 722.072301] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 722.072301] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 722.072301] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 722.072380] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 722.072522] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 722.093032] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 722.093206] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 722.093427] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 722.093687] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "network-107" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.094021] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock port-b78df071-eb7f-4dbd-b8a4-55a508508471 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.094269] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "port-b78df071-eb7f-4dbd-b8a4-55a508508471" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.094331] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "port-b78df071-eb7f-4dbd-b8a4-55a508508471" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.094635] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "port-b78df071-eb7f-4dbd-b8a4-55a508508471" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.094766] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b78df071-eb7f-4dbd-b8a4-55a508508471',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 722.225711] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.227028] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.227028] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.227028] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.227028] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.227028] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.227028] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.227293] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.227293] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.227293] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.227375] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f already deleted. [ 722.227456] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.326379] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.326379] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.326492] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.326643] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.326850] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.326850] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b8aa78a-ad3e-4d9d-94d1-2156bff23176 is going to be created. [ 722.355859] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.356067] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.356067] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.358961] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.358961] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.366898] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b8aa78a-ad3e-4d9d-94d1-2156bff23176 in Status: UNINITIALIZED for 2s [ 722.602845] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.602845] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.602845] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.602845] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.602845] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.603156] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Segment Port b78df071-eb7f-4dbd-b8a4-55a508508471 not found, creating... [ 722.603156] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.603407] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.603407] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.603630] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.603750] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.604020] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.604158] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.604261] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.604449] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.604625] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.604861] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Resource: SegmentPort with ID: b78df071-eb7f-4dbd-b8a4-55a508508471 is going to be created. [ 722.628300] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 722.628527] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 722.628672] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 722.628944] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 722.629174] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 722.629393] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "port-b78df071-eb7f-4dbd-b8a4-55a508508471" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.346601] env[67094]: INFO networking_nsxv3.common.synchronization [req-298ca655-1847-4ac2-a7ae-36dc3a65112a req-fedd0c84-2544-4c65-bcb9-5b1649b7a0bb service nova] Enqueued Resource ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f with Priority: HIGHEST for action security_group_rules [ 723.346833] env[67094]: INFO networking_nsxv3.common.synchronization [req-298ca655-1847-4ac2-a7ae-36dc3a65112a req-fedd0c84-2544-4c65-bcb9-5b1649b7a0bb service nova] Enqueued Resource ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f with Priority: HIGHEST for action security_group_members [ 723.346833] env[67094]: INFO networking_nsxv3.common.synchronization [req-298ca655-1847-4ac2-a7ae-36dc3a65112a req-fedd0c84-2544-4c65-bcb9-5b1649b7a0bb service nova] Enqueued Resource ID: b78df071-eb7f-4dbd-b8a4-55a508508471 with Priority: HIGHEST for action port [ 723.347705] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f with Priority: HIGHEST for action security_group_rules [ 723.347705] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f with Priority: HIGHEST for action security_group_members [ 723.347705] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b78df071-eb7f-4dbd-b8a4-55a508508471 with Priority: HIGHEST for action port [ 723.349037] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0f2ac94a-4beb-4e79-8490-47989224cf9f taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.349037] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.349037] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.349037] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.349037] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0f2ac94a-4beb-4e79-8490-47989224cf9f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.350228] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f2ac94a-4beb-4e79-8490-47989224cf9f taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.351201] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.351274] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.351464] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.351624] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.351725] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.351787] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.352178] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.352178] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.352178] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f2ac94a-4beb-4e79-8490-47989224cf9f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.353238] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-b78df071-eb7f-4dbd-b8a4-55a508508471 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.353238] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b78df071-eb7f-4dbd-b8a4-55a508508471" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.353238] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b78df071-eb7f-4dbd-b8a4-55a508508471" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.353390] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b78df071-eb7f-4dbd-b8a4-55a508508471" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.353390] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b78df071-eb7f-4dbd-b8a4-55a508508471',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.855126] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f2ac94a-4beb-4e79-8490-47989224cf9f taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.855126] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.855126] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b78df071-eb7f-4dbd-b8a4-55a508508471 with status ACTIVE [ 723.855273] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.855513] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.855513] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.855677] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.855764] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.855943] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.857246] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.857246] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.857246] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.857246] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.857246] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.857246] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.857246] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.857246] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.857246] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.857246] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b78df071-eb7f-4dbd-b8a4-55a508508471 is going to be updated. [ 723.858077] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0f2ac94a-4beb-4e79-8490-47989224cf9f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 723.882158] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 723.882792] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 723.882882] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 723.883134] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 723.883296] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 723.883810] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b78df071-eb7f-4dbd-b8a4-55a508508471" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.360363] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0f2ac94a-4beb-4e79-8490-47989224cf9f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.377038] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b8aa78a-ad3e-4d9d-94d1-2156bff23176 in Status: SUCCESS [ 724.377260] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b8aa78a-ad3e-4d9d-94d1-2156bff23176" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.377423] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b8aa78a-ad3e-4d9d-94d1-2156bff23176" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.377657] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b8aa78a-ad3e-4d9d-94d1-2156bff23176" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.377848] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.377967] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.378046] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.378198] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.378280] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.378363] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b8aa78a-ad3e-4d9d-94d1-2156bff23176" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.378454] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6b8aa78a-ad3e-4d9d-94d1-2156bff23176',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.556123] env[67094]: INFO networking_nsxv3.common.synchronization [req-55947ae9-bf1a-4440-bfd9-5ea5a7cbce60 req-7b1b3ba9-9a0e-49ef-8a9d-9b1c08a6f55d tempest-ServersTestMultiNic-1403718544 tempest-ServersTestMultiNic-1403718544-project-member] Enqueued Resource ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 with Priority: HIGHEST for action security_group_members [ 724.556755] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 with Priority: HIGHEST for action security_group_members [ 724.557163] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f15f829-bf18-4bc7-bdf2-32c359ef7028 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.557326] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.557398] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.557628] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.557784] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.557886] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.557949] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.558114] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.558204] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.558298] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f15f829-bf18-4bc7-bdf2-32c359ef7028',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.864732] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.864898] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.864969] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.865205] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.865293] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.865409] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f is going to be created. [ 724.880298] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6b8aa78a-ad3e-4d9d-94d1-2156bff23176',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 724.896872] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.896872] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 724.896872] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 724.896872] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 724.896872] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 724.907388] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f in Status: UNINITIALIZED for 2s [ 724.989482] env[67094]: INFO networking_nsxv3.common.synchronization [req-55947ae9-bf1a-4440-bfd9-5ea5a7cbce60 req-14859a07-ad27-4d90-bb10-1c168bdc1bbb tempest-ServersTestMultiNic-1403718544 tempest-ServersTestMultiNic-1403718544-project-member] Enqueued Resource ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 with Priority: HIGHEST for action security_group_members [ 724.991804] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 with Priority: HIGHEST for action security_group_members [ 724.991804] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f15f829-bf18-4bc7-bdf2-32c359ef7028 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 724.991804] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.060123] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.060350] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.060431] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.060676] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.060775] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.061015] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.061157] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.061223] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.061409] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.061502] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.061787] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 is going to be updated. [ 725.124690] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.124903] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.125077] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.125302] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.125543] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.138922] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 in Status: IN_PROGRESS for 2s [ 725.382296] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6b8aa78a-ad3e-4d9d-94d1-2156bff23176: rpc.has_security_group_logging(os_id): False [ 725.416625] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.416625] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.416909] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.416967] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.417042] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.417593] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.417593] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.417593] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.417825] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.417825] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.417914] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b8aa78a-ad3e-4d9d-94d1-2156bff23176 is going to be created. [ 725.490742] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.490934] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.491034] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.491252] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.491470] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.504918] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b8aa78a-ad3e-4d9d-94d1-2156bff23176 in Status: IN_PROGRESS for 2s [ 725.516567] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock network-455 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.516764] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "network-455" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.516907] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "network-455" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.517305] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "network-455" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.517999] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.518197] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.518336] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.518586] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.518738] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.518956] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 725.519076] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 725.519191] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 725.519293] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 725.519409] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 725.519507] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 725.519642] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 725.542759] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 725.542942] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 725.543085] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 725.543259] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "network-455" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.543599] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock port-f96e57fb-44f0-46c6-92ba-31d9ffab1835 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.543810] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "port-f96e57fb-44f0-46c6-92ba-31d9ffab1835" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.543949] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "port-f96e57fb-44f0-46c6-92ba-31d9ffab1835" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.544275] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "port-f96e57fb-44f0-46c6-92ba-31d9ffab1835" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.544409] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f96e57fb-44f0-46c6-92ba-31d9ffab1835',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 725.900089] env[67094]: INFO networking_nsxv3.common.synchronization [req-e48aadb7-638b-4af7-9532-77821f1a8ead req-b4883003-9ce0-4517-ac19-17cd45a08004 tempest-ServerTagsTestJSON-1326017937 tempest-ServerTagsTestJSON-1326017937-project-member] Enqueued Resource ID: 0e314269-1025-4c1f-b42e-8acab2134cbb with Priority: HIGHEST for action security_group_members [ 725.900757] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e314269-1025-4c1f-b42e-8acab2134cbb with Priority: HIGHEST for action security_group_members [ 725.901097] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0e314269-1025-4c1f-b42e-8acab2134cbb taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.901248] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0e314269-1025-4c1f-b42e-8acab2134cbb" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.901307] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0e314269-1025-4c1f-b42e-8acab2134cbb" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.901507] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0e314269-1025-4c1f-b42e-8acab2134cbb" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.901658] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 725.901755] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 725.901816] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 725.902038] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 725.902188] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 725.902335] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0e314269-1025-4c1f-b42e-8acab2134cbb',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.047290] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.047573] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.047732] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.048032] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.048187] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.048558] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Segment Port f96e57fb-44f0-46c6-92ba-31d9ffab1835 not found, creating... [ 726.048656] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.048779] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.048898] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.049129] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.049330] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.049849] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.049849] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.050039] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.050183] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.050312] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.050445] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Resource: SegmentPort with ID: f96e57fb-44f0-46c6-92ba-31d9ffab1835 is going to be created. [ 726.074043] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.074237] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.074315] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.074576] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.074868] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.075130] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "port-f96e57fb-44f0-46c6-92ba-31d9ffab1835" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.407467] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.407467] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.407467] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.407467] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.407467] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.407467] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.407467] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.407467] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.407467] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.407467] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.407467] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e314269-1025-4c1f-b42e-8acab2134cbb is going to be updated. [ 726.440908] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.441091] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.441091] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.441297] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.441401] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.451841] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e314269-1025-4c1f-b42e-8acab2134cbb in Status: IN_PROGRESS for 2s [ 726.799136] env[67094]: INFO networking_nsxv3.common.synchronization [req-55947ae9-bf1a-4440-bfd9-5ea5a7cbce60 req-fa9960e4-ae40-486b-b83c-2865b65b5edc service nova] Enqueued Resource ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 with Priority: HIGHEST for action security_group_rules [ 726.799444] env[67094]: INFO networking_nsxv3.common.synchronization [req-55947ae9-bf1a-4440-bfd9-5ea5a7cbce60 req-fa9960e4-ae40-486b-b83c-2865b65b5edc service nova] Enqueued Resource ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 with Priority: HIGHEST for action security_group_members [ 726.799623] env[67094]: INFO networking_nsxv3.common.synchronization [req-55947ae9-bf1a-4440-bfd9-5ea5a7cbce60 req-fa9960e4-ae40-486b-b83c-2865b65b5edc service nova] Enqueued Resource ID: f96e57fb-44f0-46c6-92ba-31d9ffab1835 with Priority: HIGHEST for action port [ 726.800488] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 with Priority: HIGHEST for action security_group_rules [ 726.800655] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 with Priority: HIGHEST for action security_group_members [ 726.800769] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f96e57fb-44f0-46c6-92ba-31d9ffab1835 with Priority: HIGHEST for action port [ 726.801106] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9f15f829-bf18-4bc7-bdf2-32c359ef7028 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.801229] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.801295] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.801490] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.801575] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9f15f829-bf18-4bc7-bdf2-32c359ef7028',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.803280] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f15f829-bf18-4bc7-bdf2-32c359ef7028 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.803409] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.803617] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-f96e57fb-44f0-46c6-92ba-31d9ffab1835 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.803977] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f96e57fb-44f0-46c6-92ba-31d9ffab1835" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.803977] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f96e57fb-44f0-46c6-92ba-31d9ffab1835" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.804630] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f96e57fb-44f0-46c6-92ba-31d9ffab1835" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.804759] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f96e57fb-44f0-46c6-92ba-31d9ffab1835',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 726.918064] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f in Status: SUCCESS [ 726.918351] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.918525] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.918784] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.918986] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 726.919119] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 726.919194] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 726.919352] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 726.919437] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.919529] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 726.919620] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0f2ac94a-4beb-4e79-8490-47989224cf9f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.149020] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 in Status: SUCCESS [ 727.149286] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 deletion is rescheduled due to dependency. [ 727.149400] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.149719] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.150467] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.150467] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.150467] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.150657] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.150698] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.150812] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.150947] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f15f829-bf18-4bc7-bdf2-32c359ef7028',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.310368] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f15f829-bf18-4bc7-bdf2-32c359ef7028 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.310368] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.310368] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f96e57fb-44f0-46c6-92ba-31d9ffab1835 with status ACTIVE [ 727.310368] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.310368] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.310368] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.310368] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.310368] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.310773] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.310773] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.310773] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.310773] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.310890] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.311048] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.311140] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.311200] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.311338] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.311411] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.311492] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f96e57fb-44f0-46c6-92ba-31d9ffab1835 is going to be updated. [ 727.339250] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.339250] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.339250] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.339250] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.340122] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.340317] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f96e57fb-44f0-46c6-92ba-31d9ffab1835" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.422690] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f2ac94a-4beb-4e79-8490-47989224cf9f taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.423100] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.423100] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.423410] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.423619] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.423771] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.423879] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.424178] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.424178] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.424370] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.424540] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f2ac94a-4beb-4e79-8490-47989224cf9f taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.424657] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.424749] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.424938] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.425136] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.425279] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.425434] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.425961] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.426102] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.426239] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.426374] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0f2ac94a-4beb-4e79-8490-47989224cf9f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.482523] env[67094]: INFO networking_nsxv3.common.synchronization [req-d2dc22b5-af9d-48b9-8e48-24d7bd9f7b53 req-7e145274-491d-4ca2-bea3-1131f6fdb027 tempest-ServerMetadataNegativeTestJSON-362294196 tempest-ServerMetadataNegativeTestJSON-362294196-project-member] Enqueued Resource ID: 8e29f908-2bce-40a4-9ad1-3ef30230e8e5 with Priority: HIGHEST for action security_group_members [ 727.483172] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e29f908-2bce-40a4-9ad1-3ef30230e8e5 with Priority: HIGHEST for action security_group_members [ 727.484124] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e29f908-2bce-40a4-9ad1-3ef30230e8e5 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.484309] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e29f908-2bce-40a4-9ad1-3ef30230e8e5" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.484404] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e29f908-2bce-40a4-9ad1-3ef30230e8e5" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.484683] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e29f908-2bce-40a4-9ad1-3ef30230e8e5" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.484861] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.484966] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.485038] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.485207] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.485296] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.485400] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e29f908-2bce-40a4-9ad1-3ef30230e8e5',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.522624] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b8aa78a-ad3e-4d9d-94d1-2156bff23176 in Status: SUCCESS [ 727.523374] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b8aa78a-ad3e-4d9d-94d1-2156bff23176" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.655717] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9f15f829-bf18-4bc7-bdf2-32c359ef7028',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.900786] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock network-300 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.900981] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "network-300" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.901116] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "network-300" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.901454] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "network-300" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.901718] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.901914] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.902554] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.902840] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.902992] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.904271] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 727.904391] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 727.904500] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 727.904617] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 727.904725] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 727.904830] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 727.904971] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 727.926740] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 727.926905] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 727.927058] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 727.927238] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "network-300" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.927578] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock port-dd4061f4-77b4-494f-8111-7771cb54ef01 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.927748] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "port-dd4061f4-77b4-494f-8111-7771cb54ef01" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.927906] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "port-dd4061f4-77b4-494f-8111-7771cb54ef01" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.928297] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "port-dd4061f4-77b4-494f-8111-7771cb54ef01" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.928443] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd4061f4-77b4-494f-8111-7771cb54ef01',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 727.929518] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0f2ac94a-4beb-4e79-8490-47989224cf9f: rpc.has_security_group_logging(os_id): False [ 727.949605] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.949891] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.950049] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.950262] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.950368] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.950672] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.950817] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.950906] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.951117] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.951361] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.951608] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.951902] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.952403] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.952583] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.952689] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.952894] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.952991] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.953067] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.953217] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.953292] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.953377] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f is going to be created. [ 727.987714] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.987968] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.988062] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.988786] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.988786] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.988786] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.989017] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.989017] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.989199] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.989451] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.989451] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e29f908-2bce-40a4-9ad1-3ef30230e8e5 already deleted. [ 727.989451] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e29f908-2bce-40a4-9ad1-3ef30230e8e5" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.991399] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock network-546 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.991641] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "network-546" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.991767] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "network-546" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.992094] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "network-546" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.992428] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 727.992835] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 727.992835] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 727.992835] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 727.992994] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 727.993180] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 727.993287] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 727.993385] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 727.993500] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 727.993702] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 727.993820] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 727.993947] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 728.019771] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 728.019956] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 728.020113] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 728.020288] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "network-546" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.020620] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock port-79a71681-5995-4194-9fb0-feee45c89ca4 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.020818] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "port-79a71681-5995-4194-9fb0-feee45c89ca4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.022341] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "port-79a71681-5995-4194-9fb0-feee45c89ca4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.023262] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "port-79a71681-5995-4194-9fb0-feee45c89ca4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.023262] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79a71681-5995-4194-9fb0-feee45c89ca4',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.031552] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.031700] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.031764] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.031967] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.032162] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.045283] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f in Status: IN_PROGRESS for 2s [ 728.158074] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9f15f829-bf18-4bc7-bdf2-32c359ef7028',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 728.431627] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.432065] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.432065] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.432353] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.432495] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.432753] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Segment Port dd4061f4-77b4-494f-8111-7771cb54ef01 not found, creating... [ 728.432962] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.433142] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.433256] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.433475] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.433613] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.433929] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.434089] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.434225] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.434430] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.434671] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.434732] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Resource: SegmentPort with ID: dd4061f4-77b4-494f-8111-7771cb54ef01 is going to be created. [ 728.456037] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.456198] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.456198] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.456451] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.456675] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.456896] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "port-dd4061f4-77b4-494f-8111-7771cb54ef01" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.463679] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0e314269-1025-4c1f-b42e-8acab2134cbb in Status: SUCCESS [ 728.464122] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0e314269-1025-4c1f-b42e-8acab2134cbb deletion is rescheduled due to dependency. [ 728.464122] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0e314269-1025-4c1f-b42e-8acab2134cbb" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.525941] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.526268] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.526395] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.526677] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.526825] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.527017] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Segment Port 79a71681-5995-4194-9fb0-feee45c89ca4 not found, creating... [ 728.527383] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.527598] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.527701] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.527927] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.528088] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.528360] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.528509] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.528620] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.528831] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.528996] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.529146] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Resource: SegmentPort with ID: 79a71681-5995-4194-9fb0-feee45c89ca4 is going to be created. [ 728.556234] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.556469] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.556583] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.556874] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.557115] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.557342] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "port-79a71681-5995-4194-9fb0-feee45c89ca4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.660765] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.660936] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.661022] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.661255] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.661351] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.661447] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 is going to be updated. [ 728.715157] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 728.715345] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 728.715345] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 728.715577] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 728.715725] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 728.725839] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 in Status: IN_PROGRESS for 2s [ 729.186370] env[67094]: INFO networking_nsxv3.common.synchronization [req-55947ae9-bf1a-4440-bfd9-5ea5a7cbce60 req-77b07e27-2562-41f3-9bd5-fd58b8ab5902 service nova] Enqueued Resource ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 with Priority: HIGHEST for action security_group_rules [ 729.186547] env[67094]: INFO networking_nsxv3.common.synchronization [req-55947ae9-bf1a-4440-bfd9-5ea5a7cbce60 req-77b07e27-2562-41f3-9bd5-fd58b8ab5902 service nova] Enqueued Resource ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 with Priority: HIGHEST for action security_group_members [ 729.186676] env[67094]: INFO networking_nsxv3.common.synchronization [req-55947ae9-bf1a-4440-bfd9-5ea5a7cbce60 req-77b07e27-2562-41f3-9bd5-fd58b8ab5902 service nova] Enqueued Resource ID: dd4061f4-77b4-494f-8111-7771cb54ef01 with Priority: HIGHEST for action port [ 729.187247] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 with Priority: HIGHEST for action security_group_rules [ 729.187383] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 with Priority: HIGHEST for action security_group_members [ 729.187475] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dd4061f4-77b4-494f-8111-7771cb54ef01 with Priority: HIGHEST for action port [ 729.187788] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9f15f829-bf18-4bc7-bdf2-32c359ef7028 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.187900] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.190390] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f15f829-bf18-4bc7-bdf2-32c359ef7028 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.190548] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.190836] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-dd4061f4-77b4-494f-8111-7771cb54ef01 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.190967] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dd4061f4-77b4-494f-8111-7771cb54ef01" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.190967] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dd4061f4-77b4-494f-8111-7771cb54ef01" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.191679] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dd4061f4-77b4-494f-8111-7771cb54ef01" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.191679] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dd4061f4-77b4-494f-8111-7771cb54ef01',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.291681] env[67094]: INFO networking_nsxv3.common.synchronization [req-d2dc22b5-af9d-48b9-8e48-24d7bd9f7b53 req-e322b4ee-b3c0-43b2-8a98-5b5099b7836a service nova] Enqueued Resource ID: 8e29f908-2bce-40a4-9ad1-3ef30230e8e5 with Priority: HIGHEST for action security_group_rules [ 729.292742] env[67094]: INFO networking_nsxv3.common.synchronization [req-d2dc22b5-af9d-48b9-8e48-24d7bd9f7b53 req-e322b4ee-b3c0-43b2-8a98-5b5099b7836a service nova] Enqueued Resource ID: 8e29f908-2bce-40a4-9ad1-3ef30230e8e5 with Priority: HIGHEST for action security_group_members [ 729.292941] env[67094]: INFO networking_nsxv3.common.synchronization [req-d2dc22b5-af9d-48b9-8e48-24d7bd9f7b53 req-e322b4ee-b3c0-43b2-8a98-5b5099b7836a service nova] Enqueued Resource ID: 79a71681-5995-4194-9fb0-feee45c89ca4 with Priority: HIGHEST for action port [ 729.293927] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e29f908-2bce-40a4-9ad1-3ef30230e8e5 with Priority: HIGHEST for action security_group_rules [ 729.294086] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e29f908-2bce-40a4-9ad1-3ef30230e8e5 with Priority: HIGHEST for action security_group_members [ 729.294395] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79a71681-5995-4194-9fb0-feee45c89ca4 with Priority: HIGHEST for action port [ 729.294976] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8e29f908-2bce-40a4-9ad1-3ef30230e8e5 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.295084] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8e29f908-2bce-40a4-9ad1-3ef30230e8e5" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.295233] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8e29f908-2bce-40a4-9ad1-3ef30230e8e5" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.295648] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8e29f908-2bce-40a4-9ad1-3ef30230e8e5" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.295810] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8e29f908-2bce-40a4-9ad1-3ef30230e8e5',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.297719] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e29f908-2bce-40a4-9ad1-3ef30230e8e5 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.297946] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e29f908-2bce-40a4-9ad1-3ef30230e8e5" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.298088] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e29f908-2bce-40a4-9ad1-3ef30230e8e5" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.298856] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e29f908-2bce-40a4-9ad1-3ef30230e8e5" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.298856] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.301068] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.301068] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.301068] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.301068] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.301068] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e29f908-2bce-40a4-9ad1-3ef30230e8e5',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.301727] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-79a71681-5995-4194-9fb0-feee45c89ca4 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.301727] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-79a71681-5995-4194-9fb0-feee45c89ca4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.301727] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-79a71681-5995-4194-9fb0-feee45c89ca4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.301727] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-79a71681-5995-4194-9fb0-feee45c89ca4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.302181] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79a71681-5995-4194-9fb0-feee45c89ca4',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.697217] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dd4061f4-77b4-494f-8111-7771cb54ef01 with status ACTIVE [ 729.697217] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.697217] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.697217] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.697685] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.697685] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.697969] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.698090] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.698150] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.698322] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.698408] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.698637] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.698728] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.698797] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.698951] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.699034] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.699115] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dd4061f4-77b4-494f-8111-7771cb54ef01 is going to be updated. [ 729.726189] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.726403] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.726448] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.726955] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.726955] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.727195] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dd4061f4-77b4-494f-8111-7771cb54ef01" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.806904] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e29f908-2bce-40a4-9ad1-3ef30230e8e5 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.807108] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e29f908-2bce-40a4-9ad1-3ef30230e8e5" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.807365] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8e29f908-2bce-40a4-9ad1-3ef30230e8e5',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 729.808639] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 79a71681-5995-4194-9fb0-feee45c89ca4 with status ACTIVE [ 729.809320] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.809320] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.809320] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.809575] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.809829] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.809829] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.810075] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.810154] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.810302] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.810401] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.810588] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.810890] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.810890] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.810890] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.811061] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.811061] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 79a71681-5995-4194-9fb0-feee45c89ca4 is going to be updated. [ 729.854831] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 729.855084] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 729.855220] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 729.855586] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 729.855775] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 729.856022] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-79a71681-5995-4194-9fb0-feee45c89ca4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.059421] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f in Status: SUCCESS [ 730.061191] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.314109] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8e29f908-2bce-40a4-9ad1-3ef30230e8e5',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.737067] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 in Status: SUCCESS [ 730.737450] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.737601] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.737819] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.738028] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.738204] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.738287] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.738453] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.738570] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.738677] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f15f829-bf18-4bc7-bdf2-32c359ef7028',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 730.818227] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.818227] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.819966] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.819966] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.819966] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.819966] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e29f908-2bce-40a4-9ad1-3ef30230e8e5 is going to be created. [ 730.847030] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 730.847202] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 730.847298] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 730.847624] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 730.847825] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 730.860525] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e29f908-2bce-40a4-9ad1-3ef30230e8e5 in Status: UNINITIALIZED for 2s [ 731.175315] env[67094]: INFO networking_nsxv3.common.synchronization [req-cf092f8f-7a62-4faa-a07f-f3e236813fbf req-a480b35f-9925-4f39-89c1-b0676ec39424 tempest-ServersAdminTestJSON-236082081 tempest-ServersAdminTestJSON-236082081-project-member] Enqueued Resource ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f with Priority: HIGHEST for action security_group_members [ 731.176198] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f with Priority: HIGHEST for action security_group_members [ 731.176449] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f2ac94a-4beb-4e79-8490-47989224cf9f taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.176574] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.176649] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.176881] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.177102] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 731.177214] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 731.177276] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 731.177457] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 731.177610] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 731.177723] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f2ac94a-4beb-4e79-8490-47989224cf9f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.240749] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9f15f829-bf18-4bc7-bdf2-32c359ef7028',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.684018] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0f2ac94a-4beb-4e79-8490-47989224cf9f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 731.744506] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9f15f829-bf18-4bc7-bdf2-32c359ef7028',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.003898] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock network-107 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.003898] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "network-107" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.004418] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "network-107" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.004749] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "network-107" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.005045] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.005524] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.005524] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.005716] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.005768] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.005968] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 732.006081] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 732.006190] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 732.006293] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 732.006406] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 732.006508] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 732.006654] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 732.031334] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 732.031633] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 732.031918] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 732.032115] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "network-107" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.032547] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock port-b4646da8-6e33-4726-bbd1-3e14c5a4c236 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.032967] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "port-b4646da8-6e33-4726-bbd1-3e14c5a4c236" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.033147] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "port-b4646da8-6e33-4726-bbd1-3e14c5a4c236" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.033560] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "port-b4646da8-6e33-4726-bbd1-3e14c5a4c236" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.033737] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4646da8-6e33-4726-bbd1-3e14c5a4c236',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.183869] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0f2ac94a-4beb-4e79-8490-47989224cf9f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.249456] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.249456] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.249456] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.249456] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.249456] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.249456] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 is going to be updated. [ 732.295029] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.295029] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.295029] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.295029] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.295029] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.310626] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 in Status: IN_PROGRESS for 2s [ 732.537138] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.537495] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.537594] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.537879] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.538052] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.538276] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Segment Port b4646da8-6e33-4726-bbd1-3e14c5a4c236 not found, creating... [ 732.538531] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.539763] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.539763] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.539763] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.539763] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.539763] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.539763] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.539763] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.540115] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.540115] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.540115] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Resource: SegmentPort with ID: b4646da8-6e33-4726-bbd1-3e14c5a4c236 is going to be created. [ 732.562823] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.563036] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.563162] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.563440] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.563649] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.563922] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "port-b4646da8-6e33-4726-bbd1-3e14c5a4c236" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.686781] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.686781] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.686781] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.687039] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.687192] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.687242] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f is going to be updated. [ 732.720970] env[67094]: INFO networking_nsxv3.common.synchronization [None req-fbb87562-3825-45de-b53f-513b4add02c7 None None] Enqueued Resource ID: 0e85f752-7665-43a8-a8e5-47ad17b82dc5 with Priority: HIGHEST for action port [ 732.722368] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0e85f752-7665-43a8-a8e5-47ad17b82dc5 with Priority: HIGHEST for action port [ 732.722719] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-0e85f752-7665-43a8-a8e5-47ad17b82dc5 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.722850] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0e85f752-7665-43a8-a8e5-47ad17b82dc5" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.722907] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0e85f752-7665-43a8-a8e5-47ad17b82dc5" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.723184] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0e85f752-7665-43a8-a8e5-47ad17b82dc5" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.723272] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0e85f752-7665-43a8-a8e5-47ad17b82dc5',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 732.757957] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.758585] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.758585] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.758585] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.758741] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.768420] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f in Status: IN_PROGRESS for 2s [ 732.871952] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e29f908-2bce-40a4-9ad1-3ef30230e8e5 in Status: SUCCESS [ 732.872229] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e29f908-2bce-40a4-9ad1-3ef30230e8e5" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.872424] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e29f908-2bce-40a4-9ad1-3ef30230e8e5" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.872701] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e29f908-2bce-40a4-9ad1-3ef30230e8e5" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.873008] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 732.873137] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 732.873205] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 732.873383] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 732.873473] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.873592] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e29f908-2bce-40a4-9ad1-3ef30230e8e5" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 732.873742] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8e29f908-2bce-40a4-9ad1-3ef30230e8e5',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.226756] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0e85f752-7665-43a8-a8e5-47ad17b82dc5 [ 733.226756] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.226756] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.226756] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.226756] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.226756] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.226756] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0e85f752-7665-43a8-a8e5-47ad17b82dc5 already deleted. [ 733.226756] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0e85f752-7665-43a8-a8e5-47ad17b82dc5" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.283025] env[67094]: INFO networking_nsxv3.common.synchronization [req-cf092f8f-7a62-4faa-a07f-f3e236813fbf req-ce7e2211-4dea-455e-8f8f-eff8c8a7436c service nova] Enqueued Resource ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f with Priority: HIGHEST for action security_group_rules [ 733.283025] env[67094]: INFO networking_nsxv3.common.synchronization [req-cf092f8f-7a62-4faa-a07f-f3e236813fbf req-ce7e2211-4dea-455e-8f8f-eff8c8a7436c service nova] Enqueued Resource ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f with Priority: HIGHEST for action security_group_members [ 733.283025] env[67094]: INFO networking_nsxv3.common.synchronization [req-cf092f8f-7a62-4faa-a07f-f3e236813fbf req-ce7e2211-4dea-455e-8f8f-eff8c8a7436c service nova] Enqueued Resource ID: b4646da8-6e33-4726-bbd1-3e14c5a4c236 with Priority: HIGHEST for action port [ 733.283736] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f with Priority: HIGHEST for action security_group_rules [ 733.285234] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f with Priority: HIGHEST for action security_group_members [ 733.285234] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b4646da8-6e33-4726-bbd1-3e14c5a4c236 with Priority: HIGHEST for action port [ 733.285234] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0f2ac94a-4beb-4e79-8490-47989224cf9f taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.285234] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.285234] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.285539] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.285539] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0f2ac94a-4beb-4e79-8490-47989224cf9f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.286569] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f2ac94a-4beb-4e79-8490-47989224cf9f taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.286677] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.287183] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-b4646da8-6e33-4726-bbd1-3e14c5a4c236 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.287183] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b4646da8-6e33-4726-bbd1-3e14c5a4c236" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.287183] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b4646da8-6e33-4726-bbd1-3e14c5a4c236" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.287496] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b4646da8-6e33-4726-bbd1-3e14c5a4c236" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.287496] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b4646da8-6e33-4726-bbd1-3e14c5a4c236',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.376112] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e29f908-2bce-40a4-9ad1-3ef30230e8e5 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.376385] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e29f908-2bce-40a4-9ad1-3ef30230e8e5" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.376648] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e29f908-2bce-40a4-9ad1-3ef30230e8e5" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.376848] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e29f908-2bce-40a4-9ad1-3ef30230e8e5" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.377124] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.377291] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.377396] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.377660] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.377829] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.378015] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e29f908-2bce-40a4-9ad1-3ef30230e8e5" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.378282] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e29f908-2bce-40a4-9ad1-3ef30230e8e5 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.378438] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e29f908-2bce-40a4-9ad1-3ef30230e8e5" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.378564] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e29f908-2bce-40a4-9ad1-3ef30230e8e5" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.378824] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e29f908-2bce-40a4-9ad1-3ef30230e8e5" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.379063] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.379219] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.379353] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.379602] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.379742] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.379886] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e29f908-2bce-40a4-9ad1-3ef30230e8e5" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.380068] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8e29f908-2bce-40a4-9ad1-3ef30230e8e5',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.779320] env[67094]: INFO networking_nsxv3.common.synchronization [req-2746f49a-4353-4c9a-9511-f75e126b0c62 req-58df894b-c8a2-43ca-8b07-22c1f6ed6e64 tempest-ServerAddressesTestJSON-610453416 tempest-ServerAddressesTestJSON-610453416-project-member] Enqueued Resource ID: d2b2ce4e-7111-4ad3-93ce-373e771f2b15 with Priority: HIGHEST for action security_group_members [ 733.779963] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2b2ce4e-7111-4ad3-93ce-373e771f2b15 with Priority: HIGHEST for action security_group_members [ 733.780516] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2b2ce4e-7111-4ad3-93ce-373e771f2b15 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.780516] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2b2ce4e-7111-4ad3-93ce-373e771f2b15" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.780516] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2b2ce4e-7111-4ad3-93ce-373e771f2b15" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.780731] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2b2ce4e-7111-4ad3-93ce-373e771f2b15" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.780904] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.781034] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.781115] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.781259] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.781348] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.781446] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2b2ce4e-7111-4ad3-93ce-373e771f2b15',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 733.789508] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f2ac94a-4beb-4e79-8490-47989224cf9f taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.789688] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.790707] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b4646da8-6e33-4726-bbd1-3e14c5a4c236 with status ACTIVE [ 733.790707] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.790707] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.790707] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.790707] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.790707] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.790981] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.790981] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.790981] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.791220] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.791322] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.792215] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.792215] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.792215] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.792215] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.792215] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.792215] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b4646da8-6e33-4726-bbd1-3e14c5a4c236 is going to be updated. [ 733.817176] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.817379] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.817423] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.817707] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.817865] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.818036] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b4646da8-6e33-4726-bbd1-3e14c5a4c236" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.882326] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8e29f908-2bce-40a4-9ad1-3ef30230e8e5: rpc.has_security_group_logging(os_id): False [ 733.903622] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.903622] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.903622] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.903888] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.903888] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.904085] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.904209] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.904308] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.904450] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.904523] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.904728] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.904826] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.904885] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.905030] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.905099] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.905347] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.905602] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.905692] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.905844] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.905955] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 733.906926] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8e29f908-2bce-40a4-9ad1-3ef30230e8e5 is going to be created. [ 733.986626] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 733.986929] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 733.987024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 733.988054] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 733.988671] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.012795] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8e29f908-2bce-40a4-9ad1-3ef30230e8e5 in Status: IN_PROGRESS for 2s [ 734.271680] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock network-606 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.271853] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "network-606" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.271853] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "network-606" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.272194] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "network-606" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.272451] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.272612] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.272718] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.274031] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.274031] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.274031] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 734.274031] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 734.274031] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 734.274031] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 734.274031] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 734.274031] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 734.274031] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 734.284708] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.284708] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.284708] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.284708] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.284708] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.284708] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.284708] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.284708] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.285313] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.285313] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.285313] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2b2ce4e-7111-4ad3-93ce-373e771f2b15 already deleted. [ 734.285313] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2b2ce4e-7111-4ad3-93ce-373e771f2b15" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.297756] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 734.298444] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 734.298444] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 734.298641] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "network-606" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.299019] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock port-596fe4f4-0633-4028-8c56-b534f1c862d8 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.299198] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "port-596fe4f4-0633-4028-8c56-b534f1c862d8" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.299320] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "port-596fe4f4-0633-4028-8c56-b534f1c862d8" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.299649] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "port-596fe4f4-0633-4028-8c56-b534f1c862d8" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.299788] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('596fe4f4-0633-4028-8c56-b534f1c862d8',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.322610] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 in Status: SUCCESS [ 734.322610] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.322610] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.322817] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.322977] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.323500] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.323500] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.323500] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.323676] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.323676] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.323773] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9f15f829-bf18-4bc7-bdf2-32c359ef7028',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.325071] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.325258] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.326126] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.326126] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.326126] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.326126] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.326126] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.326126] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f15f829-bf18-4bc7-bdf2-32c359ef7028',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.779451] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f in Status: SUCCESS [ 734.779885] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.780393] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.780579] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.780887] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.781123] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.781258] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.781530] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.781791] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.781946] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f2ac94a-4beb-4e79-8490-47989224cf9f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 734.802947] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.803259] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.803397] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.803689] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.803889] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.804090] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Segment Port 596fe4f4-0633-4028-8c56-b534f1c862d8 not found, creating... [ 734.804421] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.804601] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.804754] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.804992] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.805387] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.805597] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.805760] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.805896] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.806170] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.806349] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.806487] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Resource: SegmentPort with ID: 596fe4f4-0633-4028-8c56-b534f1c862d8 is going to be created. [ 734.827278] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.827578] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.827745] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 734.828030] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 734.828334] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.828616] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "port-596fe4f4-0633-4028-8c56-b534f1c862d8" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 734.829594] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f15f829-bf18-4bc7-bdf2-32c359ef7028 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 734.829725] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 734.830272] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9f15f829-bf18-4bc7-bdf2-32c359ef7028',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.213140] env[67094]: INFO networking_nsxv3.common.synchronization [None req-d7072bd0-05e1-4c90-8fe1-38e3786ad076 None None] Enqueued Resource ID: 226e99e0-d48c-4cca-9a08-a86278825a7e with Priority: HIGHEST for action port [ 735.214194] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 226e99e0-d48c-4cca-9a08-a86278825a7e with Priority: HIGHEST for action port [ 735.215867] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-226e99e0-d48c-4cca-9a08-a86278825a7e taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.215867] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-226e99e0-d48c-4cca-9a08-a86278825a7e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.215867] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-226e99e0-d48c-4cca-9a08-a86278825a7e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.215867] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-226e99e0-d48c-4cca-9a08-a86278825a7e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.215867] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('226e99e0-d48c-4cca-9a08-a86278825a7e',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.284903] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0f2ac94a-4beb-4e79-8490-47989224cf9f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.332047] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9f15f829-bf18-4bc7-bdf2-32c359ef7028',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.515152] env[67094]: INFO networking_nsxv3.common.synchronization [req-2746f49a-4353-4c9a-9511-f75e126b0c62 req-6d425c69-5dbe-4e36-b28f-8de3e60bfc8d service nova] Enqueued Resource ID: d2b2ce4e-7111-4ad3-93ce-373e771f2b15 with Priority: HIGHEST for action security_group_rules [ 735.515746] env[67094]: INFO networking_nsxv3.common.synchronization [req-2746f49a-4353-4c9a-9511-f75e126b0c62 req-6d425c69-5dbe-4e36-b28f-8de3e60bfc8d service nova] Enqueued Resource ID: d2b2ce4e-7111-4ad3-93ce-373e771f2b15 with Priority: HIGHEST for action security_group_members [ 735.515746] env[67094]: INFO networking_nsxv3.common.synchronization [req-2746f49a-4353-4c9a-9511-f75e126b0c62 req-6d425c69-5dbe-4e36-b28f-8de3e60bfc8d service nova] Enqueued Resource ID: 596fe4f4-0633-4028-8c56-b534f1c862d8 with Priority: HIGHEST for action port [ 735.516597] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2b2ce4e-7111-4ad3-93ce-373e771f2b15 with Priority: HIGHEST for action security_group_rules [ 735.516597] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2b2ce4e-7111-4ad3-93ce-373e771f2b15 with Priority: HIGHEST for action security_group_members [ 735.516827] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 596fe4f4-0633-4028-8c56-b534f1c862d8 with Priority: HIGHEST for action port [ 735.517303] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d2b2ce4e-7111-4ad3-93ce-373e771f2b15 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.517736] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d2b2ce4e-7111-4ad3-93ce-373e771f2b15" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.517736] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d2b2ce4e-7111-4ad3-93ce-373e771f2b15" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.517830] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d2b2ce4e-7111-4ad3-93ce-373e771f2b15" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.517858] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d2b2ce4e-7111-4ad3-93ce-373e771f2b15',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.519183] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2b2ce4e-7111-4ad3-93ce-373e771f2b15 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.519183] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2b2ce4e-7111-4ad3-93ce-373e771f2b15" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.519183] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2b2ce4e-7111-4ad3-93ce-373e771f2b15" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.519414] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2b2ce4e-7111-4ad3-93ce-373e771f2b15" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.520050] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.520050] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.520050] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.520050] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.520050] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.520303] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2b2ce4e-7111-4ad3-93ce-373e771f2b15',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.521593] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-596fe4f4-0633-4028-8c56-b534f1c862d8 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.522687] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-596fe4f4-0633-4028-8c56-b534f1c862d8" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.522687] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-596fe4f4-0633-4028-8c56-b534f1c862d8" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.522687] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-596fe4f4-0633-4028-8c56-b534f1c862d8" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.522687] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('596fe4f4-0633-4028-8c56-b534f1c862d8',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.717173] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 226e99e0-d48c-4cca-9a08-a86278825a7e [ 735.717581] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.717818] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.717905] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.718201] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.718303] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.718414] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:226e99e0-d48c-4cca-9a08-a86278825a7e already deleted. [ 735.718536] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-226e99e0-d48c-4cca-9a08-a86278825a7e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.786897] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0f2ac94a-4beb-4e79-8490-47989224cf9f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 735.835172] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.836055] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.836055] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.836314] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.836314] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.836461] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 is going to be updated. [ 735.870273] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 735.870534] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 735.870719] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 735.871062] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 735.871272] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 735.883943] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 in Status: IN_PROGRESS for 2s [ 736.024485] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2b2ce4e-7111-4ad3-93ce-373e771f2b15 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.024817] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2b2ce4e-7111-4ad3-93ce-373e771f2b15" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.025179] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('d2b2ce4e-7111-4ad3-93ce-373e771f2b15',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.026487] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 596fe4f4-0633-4028-8c56-b534f1c862d8 with status ACTIVE [ 736.026742] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.026880] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.026965] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.027269] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.027407] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.027652] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.027786] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.027858] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.028026] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.028218] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.028380] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.028545] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.028545] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.028774] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.028853] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.029020] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 596fe4f4-0633-4028-8c56-b534f1c862d8 is going to be updated. [ 736.040821] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8e29f908-2bce-40a4-9ad1-3ef30230e8e5 in Status: SUCCESS [ 736.041091] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8e29f908-2bce-40a4-9ad1-3ef30230e8e5" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.054493] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.054759] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.054759] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.054966] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.055204] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.055430] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-596fe4f4-0633-4028-8c56-b534f1c862d8" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.289656] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.289901] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.290041] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.290333] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.290485] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.290636] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f is going to be updated. [ 736.341392] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.341541] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.341614] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.341982] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.342774] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.354679] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f in Status: IN_PROGRESS for 2s [ 736.498990] env[67094]: INFO networking_nsxv3.common.synchronization [req-d74e633a-9f9b-4e2c-872a-4c529f61504d req-4db0e28b-659c-4f18-8fa9-17242dcc03ce tempest-ImagesOneServerNegativeTestJSON-1967011174 tempest-ImagesOneServerNegativeTestJSON-1967011174-project-member] Enqueued Resource ID: 71aa8195-5281-4a1c-b9a7-3d40e851f47e with Priority: HIGHEST for action security_group_members [ 736.499735] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71aa8195-5281-4a1c-b9a7-3d40e851f47e with Priority: HIGHEST for action security_group_members [ 736.500372] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-71aa8195-5281-4a1c-b9a7-3d40e851f47e taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.500523] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.500573] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.500849] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.501350] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.501350] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.501350] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.501549] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.501549] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.501625] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('71aa8195-5281-4a1c-b9a7-3d40e851f47e',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.530786] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('d2b2ce4e-7111-4ad3-93ce-373e771f2b15',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 736.886024] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock network-578 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.886024] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "network-578" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.886024] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "network-578" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.886449] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "network-578" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.886449] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.886561] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.886694] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.887081] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.887228] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.887429] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 736.887535] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 736.887699] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 736.887806] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 736.887910] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 736.888018] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 736.888143] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 736.913735] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 736.913901] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 736.914071] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 736.914285] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "network-578" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 736.914590] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock port-16e62914-0a8a-401a-90fa-c5d22e8e5f28 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 736.914780] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "port-16e62914-0a8a-401a-90fa-c5d22e8e5f28" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 736.914914] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "port-16e62914-0a8a-401a-90fa-c5d22e8e5f28" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 736.915271] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "port-16e62914-0a8a-401a-90fa-c5d22e8e5f28" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 736.915432] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16e62914-0a8a-401a-90fa-c5d22e8e5f28',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 737.005638] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.005796] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.005796] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.006017] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.006111] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.006311] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.006445] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.006500] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.006891] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.006891] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.006891] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71aa8195-5281-4a1c-b9a7-3d40e851f47e already deleted. [ 737.006891] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.034824] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.035056] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.035175] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.035481] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.035629] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.035771] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2b2ce4e-7111-4ad3-93ce-373e771f2b15 is going to be created. [ 737.070348] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.070348] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.070348] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.070555] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.070868] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.082553] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2b2ce4e-7111-4ad3-93ce-373e771f2b15 in Status: UNINITIALIZED for 2s [ 737.418048] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.418300] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.418417] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.418740] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.419387] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.419567] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Segment Port 16e62914-0a8a-401a-90fa-c5d22e8e5f28 not found, creating... [ 737.419891] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.420103] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.420235] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.420538] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.420671] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.420999] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.421192] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.421322] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.421554] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.421685] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.421828] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Resource: SegmentPort with ID: 16e62914-0a8a-401a-90fa-c5d22e8e5f28 is going to be created. [ 737.449224] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.449550] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.449740] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.450162] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.450501] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.450829] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "port-16e62914-0a8a-401a-90fa-c5d22e8e5f28" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.897027] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 in Status: SUCCESS [ 737.897498] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.897803] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.898104] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.898382] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.898531] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.898967] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.898967] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.898967] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.899195] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.899497] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f15f829-bf18-4bc7-bdf2-32c359ef7028 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.899497] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.899905] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.899905] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.900042] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 737.900113] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 737.900220] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 737.900451] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 737.900668] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.900769] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 737.900857] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9f15f829-bf18-4bc7-bdf2-32c359ef7028',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.228026] env[67094]: INFO networking_nsxv3.common.synchronization [req-d74e633a-9f9b-4e2c-872a-4c529f61504d req-c88f5d0d-2ac9-4b52-a2f4-db395664e300 service nova] Enqueued Resource ID: 71aa8195-5281-4a1c-b9a7-3d40e851f47e with Priority: HIGHEST for action security_group_rules [ 738.228026] env[67094]: INFO networking_nsxv3.common.synchronization [req-d74e633a-9f9b-4e2c-872a-4c529f61504d req-c88f5d0d-2ac9-4b52-a2f4-db395664e300 service nova] Enqueued Resource ID: 71aa8195-5281-4a1c-b9a7-3d40e851f47e with Priority: HIGHEST for action security_group_members [ 738.228026] env[67094]: INFO networking_nsxv3.common.synchronization [req-d74e633a-9f9b-4e2c-872a-4c529f61504d req-c88f5d0d-2ac9-4b52-a2f4-db395664e300 service nova] Enqueued Resource ID: 16e62914-0a8a-401a-90fa-c5d22e8e5f28 with Priority: HIGHEST for action port [ 738.228026] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71aa8195-5281-4a1c-b9a7-3d40e851f47e with Priority: HIGHEST for action security_group_rules [ 738.228026] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71aa8195-5281-4a1c-b9a7-3d40e851f47e with Priority: HIGHEST for action security_group_members [ 738.228026] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16e62914-0a8a-401a-90fa-c5d22e8e5f28 with Priority: HIGHEST for action port [ 738.228026] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-71aa8195-5281-4a1c-b9a7-3d40e851f47e taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.228571] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.228771] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.229242] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.229607] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('71aa8195-5281-4a1c-b9a7-3d40e851f47e',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.230624] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-71aa8195-5281-4a1c-b9a7-3d40e851f47e taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.230997] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.230997] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.232942] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.232942] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.232942] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.232942] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.232942] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.232942] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.232942] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('71aa8195-5281-4a1c-b9a7-3d40e851f47e',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.232942] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-16e62914-0a8a-401a-90fa-c5d22e8e5f28 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.232942] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-16e62914-0a8a-401a-90fa-c5d22e8e5f28" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.232942] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-16e62914-0a8a-401a-90fa-c5d22e8e5f28" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.234834] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-16e62914-0a8a-401a-90fa-c5d22e8e5f28" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.234834] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16e62914-0a8a-401a-90fa-c5d22e8e5f28',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.368524] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f in Status: SUCCESS [ 738.368524] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.368524] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.368744] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.368967] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.369098] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.372074] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.372229] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.372291] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.372384] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.372473] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0f2ac94a-4beb-4e79-8490-47989224cf9f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.403549] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9f15f829-bf18-4bc7-bdf2-32c359ef7028: rpc.has_security_group_logging(os_id): False [ 738.436990] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.438519] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.438519] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.438519] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.438519] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.438519] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.438519] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.438519] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.438519] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.438519] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.438519] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.438519] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.438519] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.439396] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.439396] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.439396] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.440085] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.440085] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.440229] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.440229] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.440304] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 is going to be updated. [ 738.511845] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.512072] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.512129] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.512477] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.512477] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.531418] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 in Status: IN_PROGRESS for 2s [ 738.736825] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('71aa8195-5281-4a1c-b9a7-3d40e851f47e',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 738.737394] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-71aa8195-5281-4a1c-b9a7-3d40e851f47e taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.737560] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.737804] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 16e62914-0a8a-401a-90fa-c5d22e8e5f28 with status ACTIVE [ 738.738675] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.738675] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.738675] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.738675] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.738951] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.739053] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.739403] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.739403] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.739774] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.739774] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.740897] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.740897] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.740897] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.740897] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.740897] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.741140] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 16e62914-0a8a-401a-90fa-c5d22e8e5f28 is going to be updated. [ 738.770079] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.770774] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.770852] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.771118] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.771263] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.771432] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-16e62914-0a8a-401a-90fa-c5d22e8e5f28" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.878989] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f2ac94a-4beb-4e79-8490-47989224cf9f taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.879100] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.879212] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.879885] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.879885] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.879885] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.879885] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.879885] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.880358] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.880358] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.880358] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f2ac94a-4beb-4e79-8490-47989224cf9f taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.880474] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.880474] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.880667] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.880738] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 738.880788] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 738.880836] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 738.880981] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 738.881069] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.881152] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 738.881234] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0f2ac94a-4beb-4e79-8490-47989224cf9f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.094043] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2b2ce4e-7111-4ad3-93ce-373e771f2b15 in Status: SUCCESS [ 739.094446] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2b2ce4e-7111-4ad3-93ce-373e771f2b15" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.094446] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2b2ce4e-7111-4ad3-93ce-373e771f2b15" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.094596] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2b2ce4e-7111-4ad3-93ce-373e771f2b15" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.094793] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.094911] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.094970] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.095137] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.095221] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.095324] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2b2ce4e-7111-4ad3-93ce-373e771f2b15" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.095417] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('d2b2ce4e-7111-4ad3-93ce-373e771f2b15',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.247753] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('71aa8195-5281-4a1c-b9a7-3d40e851f47e',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.384091] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0f2ac94a-4beb-4e79-8490-47989224cf9f: rpc.has_security_group_logging(os_id): False [ 739.408360] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.408514] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.408619] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.409249] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.409314] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.409968] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.409968] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.409968] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.409968] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.410153] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.410332] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.410442] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.410509] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.410672] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.410717] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.410926] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.411040] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.411104] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.411244] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.411318] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.411402] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f is going to be updated. [ 739.488057] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.488057] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.488057] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.488057] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.488057] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.499784] env[67094]: INFO networking_nsxv3.common.synchronization [req-d84f854e-250d-4b43-88f3-64e210f16ae5 req-d166485f-d613-4aae-8155-38f487f21294 tempest-InstanceActionsNegativeTestJSON-2060533162 tempest-InstanceActionsNegativeTestJSON-2060533162-project-member] Enqueued Resource ID: 23175cfa-70d8-4e87-b926-37d28add1977 with Priority: HIGHEST for action security_group_members [ 739.501025] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f in Status: IN_PROGRESS for 2s [ 739.501797] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23175cfa-70d8-4e87-b926-37d28add1977 with Priority: HIGHEST for action security_group_members [ 739.502726] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-23175cfa-70d8-4e87-b926-37d28add1977 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.502726] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23175cfa-70d8-4e87-b926-37d28add1977" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.502726] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23175cfa-70d8-4e87-b926-37d28add1977" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.503662] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23175cfa-70d8-4e87-b926-37d28add1977" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.503662] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.503662] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.503818] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.504259] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.504259] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.504259] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('23175cfa-70d8-4e87-b926-37d28add1977',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.600568] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2b2ce4e-7111-4ad3-93ce-373e771f2b15 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.600568] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2b2ce4e-7111-4ad3-93ce-373e771f2b15" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.600568] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2b2ce4e-7111-4ad3-93ce-373e771f2b15" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.603242] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2b2ce4e-7111-4ad3-93ce-373e771f2b15" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.603242] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.603242] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.603242] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.603242] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.603242] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.603242] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2b2ce4e-7111-4ad3-93ce-373e771f2b15" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.603242] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2b2ce4e-7111-4ad3-93ce-373e771f2b15 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.603242] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2b2ce4e-7111-4ad3-93ce-373e771f2b15" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.603640] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2b2ce4e-7111-4ad3-93ce-373e771f2b15" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.603640] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2b2ce4e-7111-4ad3-93ce-373e771f2b15" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.603704] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.603768] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.603829] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.604043] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.604130] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.604222] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2b2ce4e-7111-4ad3-93ce-373e771f2b15" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.604342] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('d2b2ce4e-7111-4ad3-93ce-373e771f2b15',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 739.749835] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.751970] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.751970] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.751970] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.754192] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.754192] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71aa8195-5281-4a1c-b9a7-3d40e851f47e is going to be created. [ 739.780427] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 739.780768] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 739.781173] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 739.781590] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 739.781865] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 739.794694] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71aa8195-5281-4a1c-b9a7-3d40e851f47e in Status: UNINITIALIZED for 2s [ 740.008943] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.009172] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.009434] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.010205] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.010205] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.010205] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.010335] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.010335] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.010612] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.010663] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.010832] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23175cfa-70d8-4e87-b926-37d28add1977 already deleted. [ 740.010911] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23175cfa-70d8-4e87-b926-37d28add1977" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.109529] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for d2b2ce4e-7111-4ad3-93ce-373e771f2b15: rpc.has_security_group_logging(os_id): False [ 740.132214] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.132214] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.132214] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.132576] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.132576] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.134154] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.134154] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.134154] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.134154] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.134154] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.134154] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.134154] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.134154] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.134154] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.134154] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.134154] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.134154] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.134154] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.134154] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.135529] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.135529] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d2b2ce4e-7111-4ad3-93ce-373e771f2b15 is going to be created. [ 740.139934] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock network-275 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.140311] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "network-275" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.140311] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "network-275" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.140743] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "network-275" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.141057] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.141225] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.141344] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.141558] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.141698] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.141927] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 740.142087] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 740.142204] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 740.142297] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 740.142394] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 740.142500] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 740.142754] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 740.181394] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 740.181394] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 740.181394] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 740.181394] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "network-275" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.181394] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock port-de66c47d-05c1-4b8f-8558-31546f367c82 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.181394] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "port-de66c47d-05c1-4b8f-8558-31546f367c82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.181394] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "port-de66c47d-05c1-4b8f-8558-31546f367c82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.181394] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "port-de66c47d-05c1-4b8f-8558-31546f367c82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.181855] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de66c47d-05c1-4b8f-8558-31546f367c82',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.237117] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.237375] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.237507] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.237862] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.238140] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.254851] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d2b2ce4e-7111-4ad3-93ce-373e771f2b15 in Status: IN_PROGRESS for 2s [ 740.547036] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 in Status: SUCCESS [ 740.547272] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.547539] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.547928] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.548150] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9f15f829-bf18-4bc7-bdf2-32c359ef7028',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 740.685037] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.685037] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.685283] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.685414] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.685850] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.685967] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Segment Port de66c47d-05c1-4b8f-8558-31546f367c82 not found, creating... [ 740.686235] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.686415] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.686564] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.687062] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.687062] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.687315] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.687517] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.687746] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.687941] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.688234] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.688392] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Resource: SegmentPort with ID: de66c47d-05c1-4b8f-8558-31546f367c82 is going to be created. [ 740.710653] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 740.710861] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 740.710861] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 740.711235] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 740.712990] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 740.712990] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "port-de66c47d-05c1-4b8f-8558-31546f367c82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.051108] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f15f829-bf18-4bc7-bdf2-32c359ef7028 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.051323] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.051323] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.051508] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.051706] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.051847] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.051847] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.052051] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.052135] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.052302] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.052381] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9f15f829-bf18-4bc7-bdf2-32c359ef7028',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.411178] env[67094]: INFO networking_nsxv3.common.synchronization [req-d84f854e-250d-4b43-88f3-64e210f16ae5 req-f8f0969e-b1e3-4d14-9fcc-0b0c6d80089e service nova] Enqueued Resource ID: 23175cfa-70d8-4e87-b926-37d28add1977 with Priority: HIGHEST for action security_group_rules [ 741.411178] env[67094]: INFO networking_nsxv3.common.synchronization [req-d84f854e-250d-4b43-88f3-64e210f16ae5 req-f8f0969e-b1e3-4d14-9fcc-0b0c6d80089e service nova] Enqueued Resource ID: 23175cfa-70d8-4e87-b926-37d28add1977 with Priority: HIGHEST for action security_group_members [ 741.411178] env[67094]: INFO networking_nsxv3.common.synchronization [req-d84f854e-250d-4b43-88f3-64e210f16ae5 req-f8f0969e-b1e3-4d14-9fcc-0b0c6d80089e service nova] Enqueued Resource ID: de66c47d-05c1-4b8f-8558-31546f367c82 with Priority: HIGHEST for action port [ 741.411178] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23175cfa-70d8-4e87-b926-37d28add1977 with Priority: HIGHEST for action security_group_rules [ 741.411178] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23175cfa-70d8-4e87-b926-37d28add1977 with Priority: HIGHEST for action security_group_members [ 741.412609] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de66c47d-05c1-4b8f-8558-31546f367c82 with Priority: HIGHEST for action port [ 741.413106] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-23175cfa-70d8-4e87-b926-37d28add1977 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.413809] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-23175cfa-70d8-4e87-b926-37d28add1977" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.414139] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-23175cfa-70d8-4e87-b926-37d28add1977" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.414542] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-23175cfa-70d8-4e87-b926-37d28add1977" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.414754] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('23175cfa-70d8-4e87-b926-37d28add1977',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.416935] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-23175cfa-70d8-4e87-b926-37d28add1977 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.416935] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23175cfa-70d8-4e87-b926-37d28add1977" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.416935] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23175cfa-70d8-4e87-b926-37d28add1977" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.417896] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23175cfa-70d8-4e87-b926-37d28add1977" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.417896] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.418347] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.419475] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.419475] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.419475] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.419475] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('23175cfa-70d8-4e87-b926-37d28add1977',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.420593] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-de66c47d-05c1-4b8f-8558-31546f367c82 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.420593] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de66c47d-05c1-4b8f-8558-31546f367c82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.420593] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de66c47d-05c1-4b8f-8558-31546f367c82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.420593] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de66c47d-05c1-4b8f-8558-31546f367c82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.420593] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de66c47d-05c1-4b8f-8558-31546f367c82',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.521832] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f in Status: SUCCESS [ 741.521832] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.557078] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f15f829-bf18-4bc7-bdf2-32c359ef7028 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.557078] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.557078] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.557441] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.557992] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.557992] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.557992] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.557992] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.557992] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.558235] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.558331] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f15f829-bf18-4bc7-bdf2-32c359ef7028 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.558422] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.558994] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.558994] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.558994] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.558994] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.558994] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.559220] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.559220] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.559288] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.559378] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9f15f829-bf18-4bc7-bdf2-32c359ef7028',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.806641] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71aa8195-5281-4a1c-b9a7-3d40e851f47e in Status: SUCCESS [ 741.806862] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.807047] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.807403] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.807699] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.807890] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.807982] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.809029] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.809029] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.809029] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.809029] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('71aa8195-5281-4a1c-b9a7-3d40e851f47e',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.923980] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('23175cfa-70d8-4e87-b926-37d28add1977',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 741.925097] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-23175cfa-70d8-4e87-b926-37d28add1977 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.925223] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23175cfa-70d8-4e87-b926-37d28add1977" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.925374] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port de66c47d-05c1-4b8f-8558-31546f367c82 with status ACTIVE [ 741.926899] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.926899] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.926899] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.926899] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.926899] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.926899] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.926899] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.927952] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.927952] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.927952] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.927952] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.927952] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.927952] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.927952] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.927952] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.927952] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: de66c47d-05c1-4b8f-8558-31546f367c82 is going to be updated. [ 741.956723] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 741.956723] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 741.956723] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 741.956723] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 741.956723] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 741.956723] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de66c47d-05c1-4b8f-8558-31546f367c82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.062495] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9f15f829-bf18-4bc7-bdf2-32c359ef7028: rpc.has_security_group_logging(os_id): False [ 742.099609] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.099877] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.099877] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.100130] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.100214] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.100359] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.100460] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.100521] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.100684] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.100765] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.100996] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.101111] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.101166] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.101336] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.101421] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.101658] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.101766] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.101816] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.101972] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.102061] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.102440] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 is going to be updated. [ 742.188469] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.188668] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.188668] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.188825] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.188971] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.204017] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 in Status: IN_PROGRESS for 2s [ 742.293782] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: d2b2ce4e-7111-4ad3-93ce-373e771f2b15 in Status: SUCCESS [ 742.294085] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d2b2ce4e-7111-4ad3-93ce-373e771f2b15" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.310696] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-71aa8195-5281-4a1c-b9a7-3d40e851f47e taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.310887] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.310952] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.311253] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.311434] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.311535] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.311650] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.311823] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.311912] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.312010] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.312160] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-71aa8195-5281-4a1c-b9a7-3d40e851f47e taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.312252] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.312314] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.312454] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.312587] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.312678] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.312739] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.312880] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.312956] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.313191] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.313303] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('71aa8195-5281-4a1c-b9a7-3d40e851f47e',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.429824] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('23175cfa-70d8-4e87-b926-37d28add1977',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 742.817550] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 71aa8195-5281-4a1c-b9a7-3d40e851f47e: rpc.has_security_group_logging(os_id): False [ 742.840416] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.843021] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.843021] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.843021] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.843021] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.843021] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.843021] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.843021] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.843021] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.843021] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.843021] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.843021] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.843021] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.843021] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.843021] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.843513] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.843513] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.843513] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.844043] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.844336] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.848628] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 71aa8195-5281-4a1c-b9a7-3d40e851f47e is going to be created. [ 742.913147] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.913147] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.913147] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.913147] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.913147] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.925616] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 71aa8195-5281-4a1c-b9a7-3d40e851f47e in Status: IN_PROGRESS for 2s [ 742.933569] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.933569] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.933569] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.933816] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.933947] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.934126] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23175cfa-70d8-4e87-b926-37d28add1977 is going to be created. [ 742.959740] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 742.959740] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 742.959974] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 742.960047] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 742.960259] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 742.971935] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23175cfa-70d8-4e87-b926-37d28add1977 in Status: UNINITIALIZED for 2s [ 743.047212] env[67094]: INFO networking_nsxv3.common.synchronization [None req-1fc20832-2057-4e1e-b9de-b6bfe6c3dead None None] Enqueued Resource ID: b7c3f4d8-20b9-47b0-b8cc-04b8cb92b63d with Priority: HIGHEST for action port [ 743.047212] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7c3f4d8-20b9-47b0-b8cc-04b8cb92b63d with Priority: HIGHEST for action port [ 743.047212] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-b7c3f4d8-20b9-47b0-b8cc-04b8cb92b63d taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.047677] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b7c3f4d8-20b9-47b0-b8cc-04b8cb92b63d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.047677] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b7c3f4d8-20b9-47b0-b8cc-04b8cb92b63d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.047752] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b7c3f4d8-20b9-47b0-b8cc-04b8cb92b63d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.047843] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7c3f4d8-20b9-47b0-b8cc-04b8cb92b63d',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 743.551663] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b7c3f4d8-20b9-47b0-b8cc-04b8cb92b63d [ 743.551924] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.552680] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.552680] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.552680] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.552680] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.552680] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b7c3f4d8-20b9-47b0-b8cc-04b8cb92b63d already deleted. [ 743.552680] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b7c3f4d8-20b9-47b0-b8cc-04b8cb92b63d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 743.675501] env[67094]: INFO networking_nsxv3.common.synchronization [None req-c8ed6c69-3000-47c1-8c8f-71f6c3ecbf32 None None] Enqueued Resource ID: 4b8d2c5a-7616-416b-8a82-a88fb1e90fec with Priority: HIGHEST for action port [ 743.676181] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4b8d2c5a-7616-416b-8a82-a88fb1e90fec with Priority: HIGHEST for action port [ 743.676523] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-4b8d2c5a-7616-416b-8a82-a88fb1e90fec taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 743.676675] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4b8d2c5a-7616-416b-8a82-a88fb1e90fec" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 743.676762] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4b8d2c5a-7616-416b-8a82-a88fb1e90fec" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 743.677046] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4b8d2c5a-7616-416b-8a82-a88fb1e90fec" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 743.677171] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4b8d2c5a-7616-416b-8a82-a88fb1e90fec',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 744.183565] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 4b8d2c5a-7616-416b-8a82-a88fb1e90fec [ 744.183785] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.183940] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.184050] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.185669] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.185669] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.185669] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:4b8d2c5a-7616-416b-8a82-a88fb1e90fec already deleted. [ 744.185669] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4b8d2c5a-7616-416b-8a82-a88fb1e90fec" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.220847] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 in Status: SUCCESS [ 744.225348] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.938778] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 71aa8195-5281-4a1c-b9a7-3d40e851f47e in Status: SUCCESS [ 744.939093] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.983889] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23175cfa-70d8-4e87-b926-37d28add1977 in Status: SUCCESS [ 744.984246] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23175cfa-70d8-4e87-b926-37d28add1977" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.984341] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23175cfa-70d8-4e87-b926-37d28add1977" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.985911] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23175cfa-70d8-4e87-b926-37d28add1977" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.985911] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 744.985911] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 744.985911] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 744.985911] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 744.985911] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.985911] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23175cfa-70d8-4e87-b926-37d28add1977" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 744.985911] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('23175cfa-70d8-4e87-b926-37d28add1977',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.492278] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-23175cfa-70d8-4e87-b926-37d28add1977 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.493190] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23175cfa-70d8-4e87-b926-37d28add1977" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.493190] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23175cfa-70d8-4e87-b926-37d28add1977" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.493190] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23175cfa-70d8-4e87-b926-37d28add1977" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.493190] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.493190] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.493190] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.493190] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.493481] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.493481] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23175cfa-70d8-4e87-b926-37d28add1977" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.493543] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-23175cfa-70d8-4e87-b926-37d28add1977 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.493584] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23175cfa-70d8-4e87-b926-37d28add1977" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.493727] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23175cfa-70d8-4e87-b926-37d28add1977" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.493788] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23175cfa-70d8-4e87-b926-37d28add1977" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.493941] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.494045] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.494118] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.494244] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.494305] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.494387] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23175cfa-70d8-4e87-b926-37d28add1977" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 745.494488] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('23175cfa-70d8-4e87-b926-37d28add1977',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.839346] env[67094]: INFO networking_nsxv3.common.synchronization [None req-209062d2-adb6-4ce1-85ae-cd4110b4dd25 tempest-ServerActionsV293TestJSON-121023143 tempest-ServerActionsV293TestJSON-121023143-project-member] Enqueued Resource ID: 7ec28241-1cbc-4bfa-acfa-d9a84a1a6dae with Priority: HIGHEST for action security_group_rules [ 745.839969] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ec28241-1cbc-4bfa-acfa-d9a84a1a6dae with Priority: HIGHEST for action security_group_rules [ 745.840358] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ec28241-1cbc-4bfa-acfa-d9a84a1a6dae taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.840488] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ec28241-1cbc-4bfa-acfa-d9a84a1a6dae" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.840554] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ec28241-1cbc-4bfa-acfa-d9a84a1a6dae" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.841242] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ec28241-1cbc-4bfa-acfa-d9a84a1a6dae" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.841330] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ec28241-1cbc-4bfa-acfa-d9a84a1a6dae',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.945191] env[67094]: INFO networking_nsxv3.common.synchronization [None req-7ddf4ce1-515e-41f1-a3af-01c2865418ef None None] Enqueued Resource ID: 163f4b6a-8813-4689-b2d6-bec26afdecdc with Priority: HIGHEST for action port [ 745.945779] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 163f4b6a-8813-4689-b2d6-bec26afdecdc with Priority: HIGHEST for action port [ 745.946296] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-163f4b6a-8813-4689-b2d6-bec26afdecdc taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 745.946427] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-163f4b6a-8813-4689-b2d6-bec26afdecdc" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 745.946503] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-163f4b6a-8813-4689-b2d6-bec26afdecdc" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 745.946750] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-163f4b6a-8813-4689-b2d6-bec26afdecdc" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 745.946829] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('163f4b6a-8813-4689-b2d6-bec26afdecdc',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 745.999210] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 23175cfa-70d8-4e87-b926-37d28add1977: rpc.has_security_group_logging(os_id): False [ 746.020976] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.020976] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.020976] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.021234] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.021327] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.021543] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.021698] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.021769] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.022189] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.022189] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.022189] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.022341] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.022376] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.022552] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.022607] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.022801] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.022867] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.022933] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.024434] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.026448] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.026448] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 23175cfa-70d8-4e87-b926-37d28add1977 is going to be created. [ 746.097029] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.097029] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.097029] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.097029] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.097029] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.113897] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 23175cfa-70d8-4e87-b926-37d28add1977 in Status: IN_PROGRESS for 2s [ 746.364983] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.365171] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.367118] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.367118] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.367118] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.367118] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ec28241-1cbc-4bfa-acfa-d9a84a1a6dae already deleted. [ 746.367262] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ec28241-1cbc-4bfa-acfa-d9a84a1a6dae" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.378390] env[67094]: INFO networking_nsxv3.common.synchronization [None req-e4d3d0bd-dfc4-4015-ae86-ae1897463dd5 tempest-ServerActionsV293TestJSON-121023143 tempest-ServerActionsV293TestJSON-121023143-project-member] Enqueued Resource ID: 7ec28241-1cbc-4bfa-acfa-d9a84a1a6dae with Priority: HIGHEST for action security_group_rules [ 746.378930] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ec28241-1cbc-4bfa-acfa-d9a84a1a6dae with Priority: HIGHEST for action security_group_rules [ 746.379287] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ec28241-1cbc-4bfa-acfa-d9a84a1a6dae taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.379763] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ec28241-1cbc-4bfa-acfa-d9a84a1a6dae" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.379875] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ec28241-1cbc-4bfa-acfa-d9a84a1a6dae" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.380086] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ec28241-1cbc-4bfa-acfa-d9a84a1a6dae" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.380195] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ec28241-1cbc-4bfa-acfa-d9a84a1a6dae',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.451992] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 163f4b6a-8813-4689-b2d6-bec26afdecdc [ 746.451992] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.451992] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.451992] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.451992] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.451992] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.451992] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:163f4b6a-8813-4689-b2d6-bec26afdecdc already deleted. [ 746.451992] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-163f4b6a-8813-4689-b2d6-bec26afdecdc" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.523563] env[67094]: INFO networking_nsxv3.common.synchronization [None req-787a48eb-3c37-42a3-aaf0-f8fc9f3ac17d None None] Enqueued Resource ID: 85c06451-8428-406f-b31b-7a02a5cfe817 with Priority: HIGHEST for action port [ 746.523710] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 85c06451-8428-406f-b31b-7a02a5cfe817 with Priority: HIGHEST for action port [ 746.524267] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-85c06451-8428-406f-b31b-7a02a5cfe817 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.524391] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-85c06451-8428-406f-b31b-7a02a5cfe817" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.524670] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-85c06451-8428-406f-b31b-7a02a5cfe817" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.524824] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-85c06451-8428-406f-b31b-7a02a5cfe817" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.524824] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('85c06451-8428-406f-b31b-7a02a5cfe817',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.771738] env[67094]: INFO networking_nsxv3.common.synchronization [None req-9fffd8f9-a112-4723-9f3f-90c2c8a3a372 None None] Enqueued Resource ID: 86f2e477-2090-4096-ae1d-f187cf3d2f77 with Priority: HIGHEST for action port [ 746.772683] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 86f2e477-2090-4096-ae1d-f187cf3d2f77 with Priority: HIGHEST for action port [ 746.772683] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-86f2e477-2090-4096-ae1d-f187cf3d2f77 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.772791] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-86f2e477-2090-4096-ae1d-f187cf3d2f77" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.772879] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-86f2e477-2090-4096-ae1d-f187cf3d2f77" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.777166] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-86f2e477-2090-4096-ae1d-f187cf3d2f77" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.777166] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('86f2e477-2090-4096-ae1d-f187cf3d2f77',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 746.904584] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 746.904699] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 746.904737] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 746.905430] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 746.905430] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 746.905430] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ec28241-1cbc-4bfa-acfa-d9a84a1a6dae already deleted. [ 746.905430] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ec28241-1cbc-4bfa-acfa-d9a84a1a6dae" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.027610] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 85c06451-8428-406f-b31b-7a02a5cfe817 [ 747.027610] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.027610] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.027610] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.028128] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.028128] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.028128] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:85c06451-8428-406f-b31b-7a02a5cfe817 already deleted. [ 747.028235] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-85c06451-8428-406f-b31b-7a02a5cfe817" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.280676] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 86f2e477-2090-4096-ae1d-f187cf3d2f77 [ 747.280676] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 747.280676] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 747.280676] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 747.280676] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 747.280676] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 747.280676] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:86f2e477-2090-4096-ae1d-f187cf3d2f77 already deleted. [ 747.280676] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-86f2e477-2090-4096-ae1d-f187cf3d2f77" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 748.130770] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 23175cfa-70d8-4e87-b926-37d28add1977 in Status: SUCCESS [ 748.132353] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-23175cfa-70d8-4e87-b926-37d28add1977" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.431369] env[67094]: INFO networking_nsxv3.common.synchronization [None req-89ac16db-80cb-4101-ac4e-6cd88f52652c None None] Enqueued Resource ID: cd92ef38-57d6-42e1-9817-fde396104e5f with Priority: HIGHEST for action port [ 749.431791] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cd92ef38-57d6-42e1-9817-fde396104e5f with Priority: HIGHEST for action port [ 749.432815] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-cd92ef38-57d6-42e1-9817-fde396104e5f taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.432815] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cd92ef38-57d6-42e1-9817-fde396104e5f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.432815] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cd92ef38-57d6-42e1-9817-fde396104e5f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.432815] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cd92ef38-57d6-42e1-9817-fde396104e5f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.432815] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cd92ef38-57d6-42e1-9817-fde396104e5f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.831291] env[67094]: INFO networking_nsxv3.common.synchronization [None req-df858484-8258-4c3a-8ea8-a879f42fd748 None None] Enqueued Resource ID: 31205c86-1369-4c7c-9261-ded47b0dde73 with Priority: HIGHEST for action port [ 749.831291] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 31205c86-1369-4c7c-9261-ded47b0dde73 with Priority: HIGHEST for action port [ 749.831291] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-31205c86-1369-4c7c-9261-ded47b0dde73 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.831291] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-31205c86-1369-4c7c-9261-ded47b0dde73" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.831291] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-31205c86-1369-4c7c-9261-ded47b0dde73" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.832386] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-31205c86-1369-4c7c-9261-ded47b0dde73" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.832917] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('31205c86-1369-4c7c-9261-ded47b0dde73',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 749.940181] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port cd92ef38-57d6-42e1-9817-fde396104e5f [ 749.940181] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 749.940181] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 749.940181] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 749.940181] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 749.940181] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 749.940181] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:cd92ef38-57d6-42e1-9817-fde396104e5f already deleted. [ 749.940181] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cd92ef38-57d6-42e1-9817-fde396104e5f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.336078] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 31205c86-1369-4c7c-9261-ded47b0dde73 [ 750.336351] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.336490] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.336559] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.336775] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.336905] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.336955] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:31205c86-1369-4c7c-9261-ded47b0dde73 already deleted. [ 750.337047] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-31205c86-1369-4c7c-9261-ded47b0dde73" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.917540] env[67094]: INFO networking_nsxv3.common.synchronization [req-8695e4c2-2bf0-4351-af31-ae5a87c45467 req-faea322a-0c38-4124-8453-90f0023c87ca tempest-ImagesTestJSON-2097058733 tempest-ImagesTestJSON-2097058733-project-member] Enqueued Resource ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa with Priority: HIGHEST for action security_group_members [ 750.919214] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa with Priority: HIGHEST for action security_group_members [ 750.919505] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-84918628-8f8e-4d25-9c0f-17cccb58ebfa taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.919637] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.919726] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.919960] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.920171] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 750.920279] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 750.920343] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 750.920505] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 750.920594] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 750.920706] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('84918628-8f8e-4d25-9c0f-17cccb58ebfa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.282519] env[67094]: INFO networking_nsxv3.common.synchronization [req-c0d73e1e-c85b-4143-be5a-f023da2e0da0 req-9d43c98b-7318-4ecc-a566-739885a53f71 tempest-ServersTestMultiNic-1403718544 tempest-ServersTestMultiNic-1403718544-project-member] Enqueued Resource ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 with Priority: HIGHEST for action security_group_members [ 751.285041] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 with Priority: HIGHEST for action security_group_members [ 751.285041] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f15f829-bf18-4bc7-bdf2-32c359ef7028 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.285041] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.285041] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.285041] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.285041] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.285041] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.285041] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.285485] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.285485] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.285485] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f15f829-bf18-4bc7-bdf2-32c359ef7028',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 751.423932] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.424120] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.424175] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.424383] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.424477] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.424671] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.424771] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.424835] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.424987] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.425103] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.425192] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa is going to be updated. [ 751.455977] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.456176] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.456228] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 751.456421] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 751.456575] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 751.471103] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa in Status: IN_PROGRESS for 2s [ 751.657140] env[67094]: INFO networking_nsxv3.common.synchronization [req-c0d73e1e-c85b-4143-be5a-f023da2e0da0 req-728870e8-54b6-480b-b2c3-db5098e26e9d tempest-ServersTestMultiNic-1403718544 tempest-ServersTestMultiNic-1403718544-project-member] Enqueued Resource ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 with Priority: HIGHEST for action security_group_members [ 751.657778] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 with Priority: HIGHEST for action security_group_members [ 751.658866] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-9f15f829-bf18-4bc7-bdf2-32c359ef7028 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 751.658983] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 751.788234] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9f15f829-bf18-4bc7-bdf2-32c359ef7028',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.294242] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9f15f829-bf18-4bc7-bdf2-32c359ef7028',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.500172] env[67094]: INFO networking_nsxv3.common.synchronization [None req-5f1e5fe3-9cea-4a2d-a07b-5a94cd6ae0aa None None] Enqueued Resource ID: efdcc74a-ddf9-4cab-ba02-8d8c8cb683d7 with Priority: HIGHEST for action port [ 752.501155] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: efdcc74a-ddf9-4cab-ba02-8d8c8cb683d7 with Priority: HIGHEST for action port [ 752.501387] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-efdcc74a-ddf9-4cab-ba02-8d8c8cb683d7 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.501491] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-efdcc74a-ddf9-4cab-ba02-8d8c8cb683d7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.501568] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-efdcc74a-ddf9-4cab-ba02-8d8c8cb683d7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.501848] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-efdcc74a-ddf9-4cab-ba02-8d8c8cb683d7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.501848] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('efdcc74a-ddf9-4cab-ba02-8d8c8cb683d7',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 752.796615] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.796816] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.796867] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.798733] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.798733] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.798733] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 is going to be updated. [ 752.869107] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 752.869107] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 752.869335] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 752.869451] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 752.869605] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 752.884578] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 in Status: IN_PROGRESS for 2s [ 753.004597] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port efdcc74a-ddf9-4cab-ba02-8d8c8cb683d7 [ 753.004800] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.004800] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.004915] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.005162] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.005302] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.005302] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:efdcc74a-ddf9-4cab-ba02-8d8c8cb683d7 already deleted. [ 753.005402] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-efdcc74a-ddf9-4cab-ba02-8d8c8cb683d7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.481630] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa in Status: SUCCESS [ 753.481932] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa deletion is rescheduled due to dependency. [ 753.481932] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 753.785106] env[67094]: INFO networking_nsxv3.common.synchronization [None req-2f57216d-a3be-4f7b-ae7c-a10d39772acd None None] Enqueued Resource ID: 0ff7f8dc-240e-47f5-8129-ea7c1097c646 with Priority: HIGHEST for action port [ 753.785234] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ff7f8dc-240e-47f5-8129-ea7c1097c646 with Priority: HIGHEST for action port [ 753.785816] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-0ff7f8dc-240e-47f5-8129-ea7c1097c646 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 753.785816] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0ff7f8dc-240e-47f5-8129-ea7c1097c646" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 753.785816] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0ff7f8dc-240e-47f5-8129-ea7c1097c646" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 753.786238] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0ff7f8dc-240e-47f5-8129-ea7c1097c646" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 753.786238] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0ff7f8dc-240e-47f5-8129-ea7c1097c646',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 754.288111] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0ff7f8dc-240e-47f5-8129-ea7c1097c646 [ 754.288359] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.288571] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.288571] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.288790] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.288887] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.289424] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0ff7f8dc-240e-47f5-8129-ea7c1097c646 already deleted. [ 754.289424] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0ff7f8dc-240e-47f5-8129-ea7c1097c646" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.903024] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 in Status: SUCCESS [ 754.903024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.903024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.903427] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.903427] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 754.903427] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 754.903631] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 754.903668] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 754.904760] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 754.904760] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9f15f829-bf18-4bc7-bdf2-32c359ef7028',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 755.408863] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.409040] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.409131] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.409416] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.409522] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.409745] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.409877] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.409920] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.410123] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.410176] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.410363] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 is going to be updated. [ 755.440921] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 755.441097] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 755.441097] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 755.441280] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 755.441417] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 755.462810] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 in Status: IN_PROGRESS for 2s [ 756.821138] env[67094]: INFO networking_nsxv3.common.synchronization [req-dd61e5d5-749d-41c4-9d9b-96aa8feaa86d req-ff6a05fe-b142-4baa-a5aa-233d517e5e77 tempest-MigrationsAdminTest-1501090521 tempest-MigrationsAdminTest-1501090521-project-member] Enqueued Resource ID: fbf0de02-2c4b-4156-ae88-4a3e624f550d with Priority: HIGHEST for action security_group_members [ 756.821138] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbf0de02-2c4b-4156-ae88-4a3e624f550d with Priority: HIGHEST for action security_group_members [ 756.821810] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbf0de02-2c4b-4156-ae88-4a3e624f550d taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.821810] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbf0de02-2c4b-4156-ae88-4a3e624f550d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.821810] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbf0de02-2c4b-4156-ae88-4a3e624f550d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.821810] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbf0de02-2c4b-4156-ae88-4a3e624f550d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.822121] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.822121] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.825042] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.825042] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.825042] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 756.825310] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fbf0de02-2c4b-4156-ae88-4a3e624f550d',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.827742] env[67094]: INFO networking_nsxv3.common.synchronization [None req-b6e78009-5a64-4057-a2b7-15e1ea3f8b53 tempest-ServersTestJSON-610582052 tempest-ServersTestJSON-610582052-project-member] Enqueued Resource ID: 2bc6c42e-23db-4008-8db7-e57d76593898 with Priority: HIGHEST for action security_group_rules [ 756.829386] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bc6c42e-23db-4008-8db7-e57d76593898 with Priority: HIGHEST for action security_group_rules [ 756.829386] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2bc6c42e-23db-4008-8db7-e57d76593898 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.829386] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2bc6c42e-23db-4008-8db7-e57d76593898" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 756.829602] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2bc6c42e-23db-4008-8db7-e57d76593898" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 756.829804] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2bc6c42e-23db-4008-8db7-e57d76593898" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 756.829877] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2bc6c42e-23db-4008-8db7-e57d76593898',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 756.994489] env[67094]: INFO networking_nsxv3.common.synchronization [None req-bcf01d34-d545-4c34-9fbe-1b9d042d257f tempest-ServersTestJSON-610582052 tempest-ServersTestJSON-610582052-project-member] Enqueued Resource ID: 2bc6c42e-23db-4008-8db7-e57d76593898 with Priority: HIGHEST for action security_group_rules [ 756.995335] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bc6c42e-23db-4008-8db7-e57d76593898 with Priority: HIGHEST for action security_group_rules [ 756.995720] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2bc6c42e-23db-4008-8db7-e57d76593898 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 756.995857] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2bc6c42e-23db-4008-8db7-e57d76593898" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.223600] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock network-653 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.224169] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "network-653" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.224387] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "network-653" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.224932] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "network-653" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.225814] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.226956] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.227100] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.227377] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.227524] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.227763] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 757.227875] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 757.227980] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 757.228359] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 757.228359] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 757.228359] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 757.228501] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 757.248478] env[67094]: INFO networking_nsxv3.common.synchronization [None req-bd1aef9c-6cb6-4f2d-9c73-0a0a768cbb34 None None] Enqueued Resource ID: 3addd01c-18e7-4075-9425-ba75b77fedb0 with Priority: HIGHEST for action port [ 757.248615] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3addd01c-18e7-4075-9425-ba75b77fedb0 with Priority: HIGHEST for action port [ 757.248990] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-3addd01c-18e7-4075-9425-ba75b77fedb0 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.249278] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3addd01c-18e7-4075-9425-ba75b77fedb0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.249278] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3addd01c-18e7-4075-9425-ba75b77fedb0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.249518] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3addd01c-18e7-4075-9425-ba75b77fedb0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.249606] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3addd01c-18e7-4075-9425-ba75b77fedb0',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.254231] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 757.254391] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 757.254524] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 757.254719] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "network-653" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.255031] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock port-fa9563f0-4a4c-4a7c-be90-8a86d5cf8d9f taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.255724] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "port-fa9563f0-4a4c-4a7c-be90-8a86d5cf8d9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.255724] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "port-fa9563f0-4a4c-4a7c-be90-8a86d5cf8d9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.255724] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "port-fa9563f0-4a4c-4a7c-be90-8a86d5cf8d9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.255877] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa9563f0-4a4c-4a7c-be90-8a86d5cf8d9f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.330163] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fbf0de02-2c4b-4156-ae88-4a3e624f550d',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.352586] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.352773] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.352861] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.353940] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.353940] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.353940] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2bc6c42e-23db-4008-8db7-e57d76593898 already deleted. [ 757.353940] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2bc6c42e-23db-4008-8db7-e57d76593898" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.354287] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2bc6c42e-23db-4008-8db7-e57d76593898" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.354523] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2bc6c42e-23db-4008-8db7-e57d76593898" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.354637] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2bc6c42e-23db-4008-8db7-e57d76593898',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.474396] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 in Status: SUCCESS [ 757.475017] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 deletion is rescheduled due to dependency. [ 757.475585] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.754528] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3addd01c-18e7-4075-9425-ba75b77fedb0 [ 757.754528] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.754528] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.754528] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.754528] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.754528] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.754528] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3addd01c-18e7-4075-9425-ba75b77fedb0 already deleted. [ 757.754528] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3addd01c-18e7-4075-9425-ba75b77fedb0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.758260] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.761037] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.761037] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.761037] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.761037] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.761037] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Segment Port fa9563f0-4a4c-4a7c-be90-8a86d5cf8d9f not found, creating... [ 757.761037] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.761037] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.761037] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.761037] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.761037] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.761986] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.762364] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.762556] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.763089] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.763279] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.763455] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Resource: SegmentPort with ID: fa9563f0-4a4c-4a7c-be90-8a86d5cf8d9f is going to be created. [ 757.791084] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.791330] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.791450] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.791825] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.792071] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.792424] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "port-fa9563f0-4a4c-4a7c-be90-8a86d5cf8d9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.833125] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fbf0de02-2c4b-4156-ae88-4a3e624f550d',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 757.878698] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 757.879952] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 757.879952] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 757.879952] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 757.879952] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 757.879952] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2bc6c42e-23db-4008-8db7-e57d76593898 already deleted. [ 757.879952] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2bc6c42e-23db-4008-8db7-e57d76593898" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.337118] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.337292] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.337367] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.337587] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.337678] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.337805] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fbf0de02-2c4b-4156-ae88-4a3e624f550d is going to be updated. [ 758.386546] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.386546] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.386546] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.387144] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.387144] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.403145] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fbf0de02-2c4b-4156-ae88-4a3e624f550d in Status: IN_PROGRESS for 2s [ 758.558038] env[67094]: INFO networking_nsxv3.common.synchronization [req-dd61e5d5-749d-41c4-9d9b-96aa8feaa86d req-ed05b352-72c0-4d2f-a1f5-5410bd2ed728 service nova] Enqueued Resource ID: fbf0de02-2c4b-4156-ae88-4a3e624f550d with Priority: HIGHEST for action security_group_rules [ 758.558255] env[67094]: INFO networking_nsxv3.common.synchronization [req-dd61e5d5-749d-41c4-9d9b-96aa8feaa86d req-ed05b352-72c0-4d2f-a1f5-5410bd2ed728 service nova] Enqueued Resource ID: fbf0de02-2c4b-4156-ae88-4a3e624f550d with Priority: HIGHEST for action security_group_members [ 758.558437] env[67094]: INFO networking_nsxv3.common.synchronization [req-dd61e5d5-749d-41c4-9d9b-96aa8feaa86d req-ed05b352-72c0-4d2f-a1f5-5410bd2ed728 service nova] Enqueued Resource ID: fa9563f0-4a4c-4a7c-be90-8a86d5cf8d9f with Priority: HIGHEST for action port [ 758.558934] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbf0de02-2c4b-4156-ae88-4a3e624f550d with Priority: HIGHEST for action security_group_rules [ 758.559637] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbf0de02-2c4b-4156-ae88-4a3e624f550d with Priority: HIGHEST for action security_group_members [ 758.559714] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa9563f0-4a4c-4a7c-be90-8a86d5cf8d9f with Priority: HIGHEST for action port [ 758.560071] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fbf0de02-2c4b-4156-ae88-4a3e624f550d taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.560199] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fbf0de02-2c4b-4156-ae88-4a3e624f550d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.560348] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fbf0de02-2c4b-4156-ae88-4a3e624f550d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.560506] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fbf0de02-2c4b-4156-ae88-4a3e624f550d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.560647] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fbf0de02-2c4b-4156-ae88-4a3e624f550d',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.562066] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbf0de02-2c4b-4156-ae88-4a3e624f550d taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.562201] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbf0de02-2c4b-4156-ae88-4a3e624f550d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.562811] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-fa9563f0-4a4c-4a7c-be90-8a86d5cf8d9f taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.562943] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fa9563f0-4a4c-4a7c-be90-8a86d5cf8d9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.562998] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fa9563f0-4a4c-4a7c-be90-8a86d5cf8d9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.563254] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fa9563f0-4a4c-4a7c-be90-8a86d5cf8d9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.563254] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa9563f0-4a4c-4a7c-be90-8a86d5cf8d9f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 758.884699] env[67094]: INFO networking_nsxv3.common.synchronization [req-64c381e1-5b7b-4840-a5ac-32191a3a9acd req-6ddac0e7-0535-4059-882e-f83445196160 tempest-ServersAdminNegativeTestJSON-87945101 tempest-ServersAdminNegativeTestJSON-87945101-project-member] Enqueued Resource ID: 75d792df-97d6-4e1a-bf50-631a4a868869 with Priority: HIGHEST for action security_group_members [ 758.885503] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75d792df-97d6-4e1a-bf50-631a4a868869 with Priority: HIGHEST for action security_group_members [ 758.886783] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-75d792df-97d6-4e1a-bf50-631a4a868869 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.886783] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-75d792df-97d6-4e1a-bf50-631a4a868869" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.886783] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-75d792df-97d6-4e1a-bf50-631a4a868869" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.886910] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-75d792df-97d6-4e1a-bf50-631a4a868869" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.887217] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 758.887293] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 758.888745] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 758.888745] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 758.888745] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 758.888745] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('75d792df-97d6-4e1a-bf50-631a4a868869',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 759.065293] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbf0de02-2c4b-4156-ae88-4a3e624f550d taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.065293] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbf0de02-2c4b-4156-ae88-4a3e624f550d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.067688] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fa9563f0-4a4c-4a7c-be90-8a86d5cf8d9f with status ACTIVE [ 759.068383] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.071037] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.071037] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.071037] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.071037] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.071037] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.071037] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.071037] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.071037] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.071037] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.071037] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.071037] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.071947] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.072334] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.072574] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.072988] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fa9563f0-4a4c-4a7c-be90-8a86d5cf8d9f is going to be updated. [ 759.099769] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.099992] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.099992] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.100372] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.100559] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.100893] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fa9563f0-4a4c-4a7c-be90-8a86d5cf8d9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.395056] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.395056] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.395056] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.395056] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.395056] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.395509] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.395509] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.395509] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.395509] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.395746] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.395746] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75d792df-97d6-4e1a-bf50-631a4a868869 is going to be updated. [ 759.444091] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 759.444489] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 759.444489] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 759.444712] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 759.444906] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 759.456395] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75d792df-97d6-4e1a-bf50-631a4a868869 in Status: IN_PROGRESS for 2s [ 760.412648] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fbf0de02-2c4b-4156-ae88-4a3e624f550d in Status: SUCCESS [ 760.412930] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbf0de02-2c4b-4156-ae88-4a3e624f550d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.413085] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbf0de02-2c4b-4156-ae88-4a3e624f550d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.415043] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbf0de02-2c4b-4156-ae88-4a3e624f550d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.415043] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 760.415043] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 760.415043] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 760.415043] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 760.415043] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 760.415043] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fbf0de02-2c4b-4156-ae88-4a3e624f550d',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 760.917931] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fbf0de02-2c4b-4156-ae88-4a3e624f550d',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.028559] env[67094]: INFO networking_nsxv3.common.synchronization [req-fd6cc3cb-d8f6-4514-9660-2a224e7b8eac req-eb0c48b2-c722-4fae-8eca-0a80dc1f58d9 tempest-InstanceActionsNegativeTestJSON-2060533162 tempest-InstanceActionsNegativeTestJSON-2060533162-project-member] Enqueued Resource ID: 23175cfa-70d8-4e87-b926-37d28add1977 with Priority: HIGHEST for action security_group_members [ 761.030389] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23175cfa-70d8-4e87-b926-37d28add1977 with Priority: HIGHEST for action security_group_members [ 761.030389] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-23175cfa-70d8-4e87-b926-37d28add1977 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.030389] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-23175cfa-70d8-4e87-b926-37d28add1977" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.030389] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-23175cfa-70d8-4e87-b926-37d28add1977" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.030389] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-23175cfa-70d8-4e87-b926-37d28add1977" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.030389] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.030389] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.031127] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.031365] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.031458] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.031559] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('23175cfa-70d8-4e87-b926-37d28add1977',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.041783] env[67094]: INFO networking_nsxv3.common.synchronization [req-78c905c2-4558-4709-aa97-6c9da94c3071 req-0c9030a0-0c1b-4388-8e99-c7d6a7b0f278 tempest-ServerAddressesTestJSON-610453416 tempest-ServerAddressesTestJSON-610453416-project-member] Enqueued Resource ID: d2b2ce4e-7111-4ad3-93ce-373e771f2b15 with Priority: HIGHEST for action security_group_members [ 761.042317] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2b2ce4e-7111-4ad3-93ce-373e771f2b15 with Priority: HIGHEST for action security_group_members [ 761.042612] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-d2b2ce4e-7111-4ad3-93ce-373e771f2b15 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.042729] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-d2b2ce4e-7111-4ad3-93ce-373e771f2b15" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.042795] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-d2b2ce4e-7111-4ad3-93ce-373e771f2b15" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.042984] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-d2b2ce4e-7111-4ad3-93ce-373e771f2b15" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.043933] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.044076] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.044710] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.044710] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.044710] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.044710] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('d2b2ce4e-7111-4ad3-93ce-373e771f2b15',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.422816] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fbf0de02-2c4b-4156-ae88-4a3e624f550d',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.466030] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 75d792df-97d6-4e1a-bf50-631a4a868869 in Status: SUCCESS [ 761.466883] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 75d792df-97d6-4e1a-bf50-631a4a868869 deletion is rescheduled due to dependency. [ 761.466883] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-75d792df-97d6-4e1a-bf50-631a4a868869" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.534883] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.535068] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.535167] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.535421] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.535556] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.535920] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.536098] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.536142] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.536310] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.536397] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.536492] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23175cfa-70d8-4e87-b926-37d28add1977 is going to be updated. [ 761.549811] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.549962] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.550065] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.550303] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.550399] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.550589] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.550682] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.550741] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.551252] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.551252] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.551252] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2b2ce4e-7111-4ad3-93ce-373e771f2b15 is going to be updated. [ 761.567689] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.568241] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.568241] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.568540] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.568691] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.577559] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23175cfa-70d8-4e87-b926-37d28add1977 in Status: IN_PROGRESS for 2s [ 761.588019] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.588019] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.588019] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.588019] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.588019] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.609996] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2b2ce4e-7111-4ad3-93ce-373e771f2b15 in Status: IN_PROGRESS for 2s [ 761.720214] env[67094]: INFO networking_nsxv3.common.synchronization [req-b1e7ba5c-1dd3-4ab4-858f-36517e30417c req-6afbdd54-7b8d-4ebf-bca9-84af1516477a tempest-SecurityGroupsTestJSON-1233321301 tempest-SecurityGroupsTestJSON-1233321301-project-member] Enqueued Resource ID: f7861002-4b91-437c-8519-9140d1a3bd82 with Priority: HIGHEST for action security_group_members [ 761.720214] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7861002-4b91-437c-8519-9140d1a3bd82 with Priority: HIGHEST for action security_group_members [ 761.720398] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7861002-4b91-437c-8519-9140d1a3bd82 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.720531] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.720623] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.721165] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.721165] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.721327] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.721674] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.721674] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.721674] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.721881] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7861002-4b91-437c-8519-9140d1a3bd82',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 761.925232] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.925393] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.925473] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.925680] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.925770] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.925869] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fbf0de02-2c4b-4156-ae88-4a3e624f550d is going to be updated. [ 761.956009] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 761.956009] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 761.956154] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 761.956436] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 761.956436] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 761.966008] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fbf0de02-2c4b-4156-ae88-4a3e624f550d in Status: IN_PROGRESS for 2s [ 762.109652] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock network-422 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.109773] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "network-422" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.109824] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "network-422" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.110149] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "network-422" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.110392] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.110538] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.110644] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.110859] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.110988] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.111610] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 762.111783] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 762.112024] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 762.112099] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 762.112515] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 762.112515] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 762.112639] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 762.141105] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 762.141105] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 762.141105] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 762.141105] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "network-422" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.141105] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock port-dbaea447-eb60-4d7b-b784-b8cea012726a taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.141105] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "port-dbaea447-eb60-4d7b-b784-b8cea012726a" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.141105] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "port-dbaea447-eb60-4d7b-b784-b8cea012726a" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.141817] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "port-dbaea447-eb60-4d7b-b784-b8cea012726a" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.141817] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dbaea447-eb60-4d7b-b784-b8cea012726a',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 762.224581] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.224858] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.224858] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.225153] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.225236] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.225445] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.225545] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.225609] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.225806] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.225884] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.225973] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7861002-4b91-437c-8519-9140d1a3bd82 already deleted. [ 762.226062] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.643895] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.644203] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.644363] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.645019] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.645019] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.645019] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Segment Port dbaea447-eb60-4d7b-b784-b8cea012726a not found, creating... [ 762.645284] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.645284] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.645284] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.646120] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.646120] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.646120] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.646120] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.646413] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.646413] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.646501] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.646568] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Resource: SegmentPort with ID: dbaea447-eb60-4d7b-b784-b8cea012726a is going to be created. [ 762.670378] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 762.670648] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 762.670701] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 762.671273] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 762.671273] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 762.671398] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "port-dbaea447-eb60-4d7b-b784-b8cea012726a" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.473579] env[67094]: INFO networking_nsxv3.common.synchronization [req-b1e7ba5c-1dd3-4ab4-858f-36517e30417c req-bbdef699-bb07-4533-be49-1bf70bd0ef93 service nova] Enqueued Resource ID: f7861002-4b91-437c-8519-9140d1a3bd82 with Priority: HIGHEST for action security_group_rules [ 763.473579] env[67094]: INFO networking_nsxv3.common.synchronization [req-b1e7ba5c-1dd3-4ab4-858f-36517e30417c req-bbdef699-bb07-4533-be49-1bf70bd0ef93 service nova] Enqueued Resource ID: f7861002-4b91-437c-8519-9140d1a3bd82 with Priority: HIGHEST for action security_group_members [ 763.473579] env[67094]: INFO networking_nsxv3.common.synchronization [req-b1e7ba5c-1dd3-4ab4-858f-36517e30417c req-bbdef699-bb07-4533-be49-1bf70bd0ef93 service nova] Enqueued Resource ID: dbaea447-eb60-4d7b-b784-b8cea012726a with Priority: HIGHEST for action port [ 763.473836] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7861002-4b91-437c-8519-9140d1a3bd82 with Priority: HIGHEST for action security_group_rules [ 763.474016] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7861002-4b91-437c-8519-9140d1a3bd82 with Priority: HIGHEST for action security_group_members [ 763.475554] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbaea447-eb60-4d7b-b784-b8cea012726a with Priority: HIGHEST for action port [ 763.475554] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f7861002-4b91-437c-8519-9140d1a3bd82 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.475554] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.475554] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.476618] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.476882] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f7861002-4b91-437c-8519-9140d1a3bd82',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.478482] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7861002-4b91-437c-8519-9140d1a3bd82 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.479172] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.479383] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.481134] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.481134] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.481134] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.481134] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.481134] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.481134] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.481134] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7861002-4b91-437c-8519-9140d1a3bd82',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.482531] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-dbaea447-eb60-4d7b-b784-b8cea012726a taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.482820] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dbaea447-eb60-4d7b-b784-b8cea012726a" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.483019] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dbaea447-eb60-4d7b-b784-b8cea012726a" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.483758] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dbaea447-eb60-4d7b-b784-b8cea012726a" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.483952] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dbaea447-eb60-4d7b-b784-b8cea012726a',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.591107] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 23175cfa-70d8-4e87-b926-37d28add1977 in Status: SUCCESS [ 763.591314] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 23175cfa-70d8-4e87-b926-37d28add1977 deletion is rescheduled due to dependency. [ 763.591430] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-23175cfa-70d8-4e87-b926-37d28add1977" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.620692] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: d2b2ce4e-7111-4ad3-93ce-373e771f2b15 in Status: SUCCESS [ 763.620805] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: d2b2ce4e-7111-4ad3-93ce-373e771f2b15 deletion is rescheduled due to dependency. [ 763.621893] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-d2b2ce4e-7111-4ad3-93ce-373e771f2b15" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.975859] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fbf0de02-2c4b-4156-ae88-4a3e624f550d in Status: SUCCESS [ 763.976141] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbf0de02-2c4b-4156-ae88-4a3e624f550d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.976265] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbf0de02-2c4b-4156-ae88-4a3e624f550d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.976455] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbf0de02-2c4b-4156-ae88-4a3e624f550d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.976655] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.976792] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.976884] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.977074] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.977172] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.977245] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbf0de02-2c4b-4156-ae88-4a3e624f550d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.977338] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fbf0de02-2c4b-4156-ae88-4a3e624f550d',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.986270] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f7861002-4b91-437c-8519-9140d1a3bd82',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 763.987256] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7861002-4b91-437c-8519-9140d1a3bd82 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.987369] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.987541] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dbaea447-eb60-4d7b-b784-b8cea012726a with status ACTIVE [ 763.987691] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.987813] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.987880] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.988087] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.988175] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.988343] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.988440] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.988502] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.988645] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.988719] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.988902] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 763.988989] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 763.989120] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 763.989245] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 763.989296] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 763.989378] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dbaea447-eb60-4d7b-b784-b8cea012726a is going to be updated. [ 764.014774] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.014774] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.014774] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.015702] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.015702] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.015702] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dbaea447-eb60-4d7b-b784-b8cea012726a" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.817121] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbf0de02-2c4b-4156-ae88-4a3e624f550d taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.817354] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbf0de02-2c4b-4156-ae88-4a3e624f550d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.817469] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbf0de02-2c4b-4156-ae88-4a3e624f550d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.817880] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbf0de02-2c4b-4156-ae88-4a3e624f550d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.818138] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.818251] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.818316] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.818502] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.818597] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.818953] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbf0de02-2c4b-4156-ae88-4a3e624f550d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.819058] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbf0de02-2c4b-4156-ae88-4a3e624f550d taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.819184] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbf0de02-2c4b-4156-ae88-4a3e624f550d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.819249] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbf0de02-2c4b-4156-ae88-4a3e624f550d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.819473] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbf0de02-2c4b-4156-ae88-4a3e624f550d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.819652] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 764.820024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 764.820024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 764.821154] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 764.821581] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.821581] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbf0de02-2c4b-4156-ae88-4a3e624f550d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 764.821702] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fbf0de02-2c4b-4156-ae88-4a3e624f550d',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 764.823170] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f7861002-4b91-437c-8519-9140d1a3bd82',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 765.328663] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fbf0de02-2c4b-4156-ae88-4a3e624f550d: rpc.has_security_group_logging(os_id): False [ 765.330561] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.330561] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.330706] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.331306] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.331306] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.331306] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7861002-4b91-437c-8519-9140d1a3bd82 is going to be created. [ 765.352189] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.352583] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.355016] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.355016] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.355016] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.355016] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.355016] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.355016] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.355016] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.355016] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.355016] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.355016] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.355016] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.355016] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.355016] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.355016] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.355719] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.355719] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.355719] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.355719] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.355719] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fbf0de02-2c4b-4156-ae88-4a3e624f550d is going to be updated. [ 765.358472] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.358836] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.359128] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.359398] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.359638] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.371684] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7861002-4b91-437c-8519-9140d1a3bd82 in Status: UNINITIALIZED for 2s [ 765.433600] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 765.435916] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 765.435916] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 765.435916] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 765.435916] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 765.454685] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fbf0de02-2c4b-4156-ae88-4a3e624f550d in Status: IN_PROGRESS for 2s [ 766.648954] env[67094]: INFO networking_nsxv3.common.synchronization [req-138cbe88-b419-4291-b5a9-7cf682fe4852 req-2661bd0b-36d7-4c3a-a6fa-eaaaf8aef523 tempest-ServerMetadataNegativeTestJSON-362294196 tempest-ServerMetadataNegativeTestJSON-362294196-project-member] Enqueued Resource ID: 8e29f908-2bce-40a4-9ad1-3ef30230e8e5 with Priority: HIGHEST for action security_group_members [ 766.649539] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e29f908-2bce-40a4-9ad1-3ef30230e8e5 with Priority: HIGHEST for action security_group_members [ 766.649844] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e29f908-2bce-40a4-9ad1-3ef30230e8e5 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.649948] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e29f908-2bce-40a4-9ad1-3ef30230e8e5" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.650088] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e29f908-2bce-40a4-9ad1-3ef30230e8e5" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.650314] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e29f908-2bce-40a4-9ad1-3ef30230e8e5" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.650480] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 766.650588] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 766.650662] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 766.650806] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 766.650891] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 766.650985] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e29f908-2bce-40a4-9ad1-3ef30230e8e5',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.152986] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.153185] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.153389] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.153498] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.153559] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.153834] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.153955] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.153998] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.154351] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.154560] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.154691] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e29f908-2bce-40a4-9ad1-3ef30230e8e5 is going to be updated. [ 767.187405] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.187569] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.187850] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.187954] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.188394] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.200800] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e29f908-2bce-40a4-9ad1-3ef30230e8e5 in Status: IN_PROGRESS for 2s [ 767.386794] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7861002-4b91-437c-8519-9140d1a3bd82 in Status: SUCCESS [ 767.386794] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.387277] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.387831] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.389355] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.389355] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.389355] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.389355] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.389355] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.389355] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.389355] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f7861002-4b91-437c-8519-9140d1a3bd82',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 767.471767] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fbf0de02-2c4b-4156-ae88-4a3e624f550d in Status: SUCCESS [ 767.472055] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fbf0de02-2c4b-4156-ae88-4a3e624f550d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.544907] env[67094]: INFO networking_nsxv3.common.synchronization [req-9f2d8733-9443-4fe1-a9f8-2f852b86f4d9 req-0920de98-a8f4-4a65-b835-52a750a0cdb3 tempest-ServersWithSpecificFlavorTestJSON-602104183 tempest-ServersWithSpecificFlavorTestJSON-602104183-project-member] Enqueued Resource ID: 60943622-73b5-4dda-ad21-63bf08db617e with Priority: HIGHEST for action security_group_members [ 767.546904] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60943622-73b5-4dda-ad21-63bf08db617e with Priority: HIGHEST for action security_group_members [ 767.547349] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-60943622-73b5-4dda-ad21-63bf08db617e taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.547566] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60943622-73b5-4dda-ad21-63bf08db617e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.547742] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60943622-73b5-4dda-ad21-63bf08db617e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.548557] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60943622-73b5-4dda-ad21-63bf08db617e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.548743] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 767.548875] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 767.548945] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 767.549150] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 767.549241] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 767.549338] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60943622-73b5-4dda-ad21-63bf08db617e',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.089908] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7861002-4b91-437c-8519-9140d1a3bd82 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.089908] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.089908] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.089908] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.089908] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.089908] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.089908] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.089908] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.089908] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.089908] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.089908] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7861002-4b91-437c-8519-9140d1a3bd82 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.089908] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.089908] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.089908] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.089908] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.089908] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.091073] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.091073] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.091073] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.091073] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.091073] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f7861002-4b91-437c-8519-9140d1a3bd82',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.094522] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.094522] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.094522] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.094522] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.094522] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.094522] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.094522] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.094522] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.094522] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.094522] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.094522] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60943622-73b5-4dda-ad21-63bf08db617e is going to be updated. [ 768.127403] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.127609] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.127609] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.127849] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.128016] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.139455] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60943622-73b5-4dda-ad21-63bf08db617e in Status: IN_PROGRESS for 2s [ 768.242448] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock network-661 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.243154] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "network-661" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.243154] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "network-661" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.243154] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "network-661" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.243709] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.243949] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.244032] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.244515] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.244738] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.244970] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 768.245447] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 768.245577] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 768.245709] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 768.245825] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 768.246145] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 768.246290] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 768.269880] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 768.269880] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 768.269880] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 768.269880] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "network-661" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.270108] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock port-b8c14438-0fe9-4433-8f74-2bb36e782b36 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.271115] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "port-b8c14438-0fe9-4433-8f74-2bb36e782b36" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.271115] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "port-b8c14438-0fe9-4433-8f74-2bb36e782b36" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.271472] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "port-b8c14438-0fe9-4433-8f74-2bb36e782b36" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.271630] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8c14438-0fe9-4433-8f74-2bb36e782b36',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 768.600277] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f7861002-4b91-437c-8519-9140d1a3bd82: rpc.has_security_group_logging(os_id): False [ 768.623962] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.624182] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.624248] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.624428] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.624534] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.624886] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.624886] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.624992] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.625077] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.625202] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.625331] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.625425] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.625542] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.625619] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.625693] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.625870] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.625957] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.626245] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.626667] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.626667] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.626776] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f7861002-4b91-437c-8519-9140d1a3bd82 is going to be created. [ 768.692290] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.692290] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.692290] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.692290] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.692290] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.707791] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7861002-4b91-437c-8519-9140d1a3bd82 in Status: IN_PROGRESS for 2s [ 768.774855] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.775054] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.775173] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.775451] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.775603] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.775759] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Segment Port b8c14438-0fe9-4433-8f74-2bb36e782b36 not found, creating... [ 768.776070] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.776240] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.776352] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.776568] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.776699] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.776978] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.779872] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.779872] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.779872] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.779872] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.779872] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Resource: SegmentPort with ID: b8c14438-0fe9-4433-8f74-2bb36e782b36 is going to be created. [ 768.853628] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 768.853628] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 768.853628] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 768.853628] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 768.853628] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 768.853628] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "port-b8c14438-0fe9-4433-8f74-2bb36e782b36" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.212993] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e29f908-2bce-40a4-9ad1-3ef30230e8e5 in Status: SUCCESS [ 769.213851] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e29f908-2bce-40a4-9ad1-3ef30230e8e5 deletion is rescheduled due to dependency. [ 769.213851] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e29f908-2bce-40a4-9ad1-3ef30230e8e5" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.521725] env[67094]: INFO networking_nsxv3.common.synchronization [req-9f2d8733-9443-4fe1-a9f8-2f852b86f4d9 req-454c3040-df04-4bf9-b3b2-3fe098e9178c service nova] Enqueued Resource ID: 60943622-73b5-4dda-ad21-63bf08db617e with Priority: HIGHEST for action security_group_rules [ 769.521900] env[67094]: INFO networking_nsxv3.common.synchronization [req-9f2d8733-9443-4fe1-a9f8-2f852b86f4d9 req-454c3040-df04-4bf9-b3b2-3fe098e9178c service nova] Enqueued Resource ID: 60943622-73b5-4dda-ad21-63bf08db617e with Priority: HIGHEST for action security_group_members [ 769.522055] env[67094]: INFO networking_nsxv3.common.synchronization [req-9f2d8733-9443-4fe1-a9f8-2f852b86f4d9 req-454c3040-df04-4bf9-b3b2-3fe098e9178c service nova] Enqueued Resource ID: b8c14438-0fe9-4433-8f74-2bb36e782b36 with Priority: HIGHEST for action port [ 769.523341] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60943622-73b5-4dda-ad21-63bf08db617e with Priority: HIGHEST for action security_group_rules [ 769.523341] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60943622-73b5-4dda-ad21-63bf08db617e with Priority: HIGHEST for action security_group_members [ 769.523341] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b8c14438-0fe9-4433-8f74-2bb36e782b36 with Priority: HIGHEST for action port [ 769.523575] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-60943622-73b5-4dda-ad21-63bf08db617e taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.523669] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-60943622-73b5-4dda-ad21-63bf08db617e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.523765] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-60943622-73b5-4dda-ad21-63bf08db617e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.524116] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-60943622-73b5-4dda-ad21-63bf08db617e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.524230] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('60943622-73b5-4dda-ad21-63bf08db617e',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.525736] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-60943622-73b5-4dda-ad21-63bf08db617e taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.525973] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60943622-73b5-4dda-ad21-63bf08db617e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.526205] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-b8c14438-0fe9-4433-8f74-2bb36e782b36 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.526314] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b8c14438-0fe9-4433-8f74-2bb36e782b36" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.526380] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b8c14438-0fe9-4433-8f74-2bb36e782b36" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.526553] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b8c14438-0fe9-4433-8f74-2bb36e782b36" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.526657] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b8c14438-0fe9-4433-8f74-2bb36e782b36',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 769.935782] env[67094]: INFO networking_nsxv3.common.synchronization [req-7353a4b9-c413-428c-8f6f-11b28c121d38 req-14224ebe-8147-4469-b5d1-92378a9e8757 tempest-ListImageFiltersTestJSON-2012211862 tempest-ListImageFiltersTestJSON-2012211862-project-member] Enqueued Resource ID: 0ee9080c-8cce-48e3-86d7-285fa4431dd0 with Priority: HIGHEST for action security_group_members [ 769.936755] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ee9080c-8cce-48e3-86d7-285fa4431dd0 with Priority: HIGHEST for action security_group_members [ 769.937200] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ee9080c-8cce-48e3-86d7-285fa4431dd0 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.937331] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.937402] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.937596] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.937749] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 769.938718] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 769.938929] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 769.939096] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 769.939220] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 769.939279] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ee9080c-8cce-48e3-86d7-285fa4431dd0',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.026912] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-60943622-73b5-4dda-ad21-63bf08db617e taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.027130] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60943622-73b5-4dda-ad21-63bf08db617e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.029070] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b8c14438-0fe9-4433-8f74-2bb36e782b36 with status ACTIVE [ 770.029070] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.029070] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.029070] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.029070] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.029070] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.029070] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.029070] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.029070] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.029614] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.029614] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.029614] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.029614] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.029614] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.032395] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.032497] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.032614] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b8c14438-0fe9-4433-8f74-2bb36e782b36 is going to be updated. [ 770.091240] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.091240] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.091240] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.091240] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.091240] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.091240] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b8c14438-0fe9-4433-8f74-2bb36e782b36" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.163072] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60943622-73b5-4dda-ad21-63bf08db617e in Status: SUCCESS [ 770.163311] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60943622-73b5-4dda-ad21-63bf08db617e deletion is rescheduled due to dependency. [ 770.163443] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60943622-73b5-4dda-ad21-63bf08db617e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.163677] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60943622-73b5-4dda-ad21-63bf08db617e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.163843] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60943622-73b5-4dda-ad21-63bf08db617e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.164429] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 770.164429] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 770.164429] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 770.164662] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 770.164662] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.164739] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60943622-73b5-4dda-ad21-63bf08db617e',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.441383] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0ee9080c-8cce-48e3-86d7-285fa4431dd0',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.606018] env[67094]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] NSXv3 Agent Agent loop - iteration:0 completed [ 770.606018] env[67094]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] NSXv3 Agent Agent loop - iteration:1 started [ 770.668269] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('60943622-73b5-4dda-ad21-63bf08db617e',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 770.729816] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7861002-4b91-437c-8519-9140d1a3bd82 in Status: SUCCESS [ 770.729816] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 770.943993] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0ee9080c-8cce-48e3-86d7-285fa4431dd0',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.033625] env[67094]: INFO networking_nsxv3.common.synchronization [req-32d9d9ac-eaa5-4cb7-8d42-98e48d038384 req-a459724b-3d03-47a3-8be5-7bb8d16d8fec tempest-ServerDiskConfigTestJSON-51233165 tempest-ServerDiskConfigTestJSON-51233165-project-member] Enqueued Resource ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 with Priority: HIGHEST for action security_group_members [ 771.035026] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 with Priority: HIGHEST for action security_group_members [ 771.035126] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.035207] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.035249] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.035620] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.035775] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.035899] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.035963] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.036204] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.036335] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.036464] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.173680] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('60943622-73b5-4dda-ad21-63bf08db617e',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.446805] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.447143] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.447143] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.447937] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.447937] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.447937] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ee9080c-8cce-48e3-86d7-285fa4431dd0 is going to be updated. [ 771.482384] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.482590] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.482673] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.482855] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.483015] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.494386] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ee9080c-8cce-48e3-86d7-285fa4431dd0 in Status: IN_PROGRESS for 2s [ 771.532667] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock network-723 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.535918] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "network-723" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.535918] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "network-723" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.535918] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "network-723" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.535918] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.535918] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.535918] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.535918] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.535918] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.535918] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 771.535918] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 771.535918] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 771.535918] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 771.535918] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 771.535918] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 771.535918] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 771.540081] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.540229] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.540305] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.540501] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.540599] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.540783] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.540882] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.540950] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.541129] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.541195] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.541284] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 already deleted. [ 771.541361] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.632537] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 771.632537] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Cache value generated in 0.096 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 771.632537] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 771.632537] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "network-723" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.632769] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock port-33101c74-8673-4c82-b7d7-fd4726799288 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.632849] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "port-33101c74-8673-4c82-b7d7-fd4726799288" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.633037] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "port-33101c74-8673-4c82-b7d7-fd4726799288" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.633740] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "port-33101c74-8673-4c82-b7d7-fd4726799288" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.634532] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33101c74-8673-4c82-b7d7-fd4726799288',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.677169] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.677774] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.678095] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.679323] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.679416] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.679725] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60943622-73b5-4dda-ad21-63bf08db617e is going to be updated. [ 771.700531] env[67094]: INFO networking_nsxv3.common.synchronization [None req-43cdfa02-0ed9-4b83-bcf0-c6f6f39d671b None None] Enqueued Resource ID: ad0679a6-de43-4795-86d8-cd10d2709125 with Priority: HIGHEST for action port [ 771.703353] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad0679a6-de43-4795-86d8-cd10d2709125 with Priority: HIGHEST for action port [ 771.703520] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-ad0679a6-de43-4795-86d8-cd10d2709125 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.703797] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ad0679a6-de43-4795-86d8-cd10d2709125" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.704937] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ad0679a6-de43-4795-86d8-cd10d2709125" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.705266] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ad0679a6-de43-4795-86d8-cd10d2709125" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.706159] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad0679a6-de43-4795-86d8-cd10d2709125',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 771.718354] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 771.718491] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 771.718678] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 771.718935] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 771.719029] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 771.732720] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60943622-73b5-4dda-ad21-63bf08db617e in Status: IN_PROGRESS for 2s [ 772.138855] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.139195] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.139318] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.139587] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.139758] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.139926] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Segment Port 33101c74-8673-4c82-b7d7-fd4726799288 not found, creating... [ 772.140198] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.140346] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.140486] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.140685] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.140811] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.141088] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.141235] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.141344] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.141536] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.141661] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.141788] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Resource: SegmentPort with ID: 33101c74-8673-4c82-b7d7-fd4726799288 is going to be created. [ 772.165183] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.165429] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.165573] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.165934] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.166212] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.166403] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "port-33101c74-8673-4c82-b7d7-fd4726799288" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.209019] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ad0679a6-de43-4795-86d8-cd10d2709125 [ 772.209443] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.209970] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.210074] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.210327] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.210415] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.210641] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ad0679a6-de43-4795-86d8-cd10d2709125 already deleted. [ 772.210641] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ad0679a6-de43-4795-86d8-cd10d2709125" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.853943] env[67094]: INFO networking_nsxv3.common.synchronization [req-32d9d9ac-eaa5-4cb7-8d42-98e48d038384 req-a36cb422-4bd7-4b5d-bfd9-4b1aa64bb246 service nova] Enqueued Resource ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 with Priority: HIGHEST for action security_group_rules [ 772.853943] env[67094]: INFO networking_nsxv3.common.synchronization [req-32d9d9ac-eaa5-4cb7-8d42-98e48d038384 req-a36cb422-4bd7-4b5d-bfd9-4b1aa64bb246 service nova] Enqueued Resource ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 with Priority: HIGHEST for action security_group_members [ 772.853943] env[67094]: INFO networking_nsxv3.common.synchronization [req-32d9d9ac-eaa5-4cb7-8d42-98e48d038384 req-a36cb422-4bd7-4b5d-bfd9-4b1aa64bb246 service nova] Enqueued Resource ID: 33101c74-8673-4c82-b7d7-fd4726799288 with Priority: HIGHEST for action port [ 772.853943] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 with Priority: HIGHEST for action security_group_rules [ 772.853943] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 with Priority: HIGHEST for action security_group_members [ 772.853943] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 33101c74-8673-4c82-b7d7-fd4726799288 with Priority: HIGHEST for action port [ 772.853943] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.853943] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.854562] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.854562] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.854562] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.855382] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.855510] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.855591] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.855777] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.856997] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.856997] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.856997] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.856997] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.856997] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 772.856997] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 772.862466] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-33101c74-8673-4c82-b7d7-fd4726799288 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 772.862615] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-33101c74-8673-4c82-b7d7-fd4726799288" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 772.862713] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-33101c74-8673-4c82-b7d7-fd4726799288" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 772.862957] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-33101c74-8673-4c82-b7d7-fd4726799288" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 772.863795] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('33101c74-8673-4c82-b7d7-fd4726799288',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.363648] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.367438] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.367438] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.367438] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 33101c74-8673-4c82-b7d7-fd4726799288 with status ACTIVE [ 773.367664] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.367739] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.367773] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.368826] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.368826] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.368826] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.368826] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.368826] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.368826] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.368826] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.369255] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.369255] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.369392] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.370235] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.370235] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.370235] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 33101c74-8673-4c82-b7d7-fd4726799288 is going to be updated. [ 773.395079] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.395273] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.395346] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.395606] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.395758] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.396016] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-33101c74-8673-4c82-b7d7-fd4726799288" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.506706] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ee9080c-8cce-48e3-86d7-285fa4431dd0 in Status: SUCCESS [ 773.507602] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.746025] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60943622-73b5-4dda-ad21-63bf08db617e in Status: SUCCESS [ 773.746025] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60943622-73b5-4dda-ad21-63bf08db617e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.746025] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60943622-73b5-4dda-ad21-63bf08db617e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.746025] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60943622-73b5-4dda-ad21-63bf08db617e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.746025] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 773.746579] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 773.746579] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 773.746579] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 773.746579] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.746579] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60943622-73b5-4dda-ad21-63bf08db617e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 773.746579] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('60943622-73b5-4dda-ad21-63bf08db617e',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 773.872671] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.252587] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('60943622-73b5-4dda-ad21-63bf08db617e',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.375522] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.375522] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.375681] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.376027] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.376027] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.376027] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 is going to be created. [ 774.405463] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.405463] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.405463] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.405463] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.405463] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.415853] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 in Status: UNINITIALIZED for 2s [ 774.561098] env[67094]: INFO networking_nsxv3.common.synchronization [req-3bfd99cc-e0b5-4027-8889-de04aab65309 req-de5e10b9-331a-4407-adab-470700d472ef tempest-FloatingIPsAssociationTestJSON-2123953573 tempest-FloatingIPsAssociationTestJSON-2123953573-project-member] Enqueued Resource ID: 79476966-6948-4fb4-811c-c9f8cee63da2 with Priority: HIGHEST for action security_group_members [ 774.561664] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79476966-6948-4fb4-811c-c9f8cee63da2 with Priority: HIGHEST for action security_group_members [ 774.562178] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-79476966-6948-4fb4-811c-c9f8cee63da2 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.562178] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.562178] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.562343] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.567348] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.567467] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.568114] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.568114] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.568114] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.568114] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('79476966-6948-4fb4-811c-c9f8cee63da2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 774.756403] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 60943622-73b5-4dda-ad21-63bf08db617e: rpc.has_security_group_logging(os_id): False [ 774.773792] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.775423] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.775550] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.775793] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.775915] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.776227] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.776338] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.776404] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.776568] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.776649] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.776742] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 60943622-73b5-4dda-ad21-63bf08db617e is going to be updated. [ 774.840493] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 774.840752] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 774.840870] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 774.841151] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 774.841361] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 774.855630] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 60943622-73b5-4dda-ad21-63bf08db617e in Status: IN_PROGRESS for 2s [ 775.071946] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('79476966-6948-4fb4-811c-c9f8cee63da2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.277609] env[67094]: INFO networking_nsxv3.common.synchronization [None req-e37281c2-0292-4184-b96a-9f0051b44872 None None] Enqueued Resource ID: 51305366-7c20-4883-b1de-272298b1bcf3 with Priority: HIGHEST for action port [ 775.278370] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51305366-7c20-4883-b1de-272298b1bcf3 with Priority: HIGHEST for action port [ 775.279299] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-51305366-7c20-4883-b1de-272298b1bcf3 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.279299] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-51305366-7c20-4883-b1de-272298b1bcf3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.279299] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-51305366-7c20-4883-b1de-272298b1bcf3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.280393] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-51305366-7c20-4883-b1de-272298b1bcf3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.280498] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('51305366-7c20-4883-b1de-272298b1bcf3',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.576497] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('79476966-6948-4fb4-811c-c9f8cee63da2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.784814] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 51305366-7c20-4883-b1de-272298b1bcf3 [ 775.784814] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.784814] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.784814] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.784814] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.784814] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.784814] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:51305366-7c20-4883-b1de-272298b1bcf3 already deleted. [ 775.784814] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-51305366-7c20-4883-b1de-272298b1bcf3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.820063] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock network-844 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.820063] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "network-844" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.820063] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "network-844" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.820063] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "network-844" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.820063] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.820063] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.820063] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.820063] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.820063] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.821088] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 775.821396] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 775.821647] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 775.821868] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 775.822116] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 775.822804] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 775.822804] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 775.843612] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 775.843784] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 775.843923] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 775.844119] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "network-844" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 775.844427] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock port-0f5b3f59-793a-4364-b36f-3f10d3c8b29c taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.844597] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "port-0f5b3f59-793a-4364-b36f-3f10d3c8b29c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.844710] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "port-0f5b3f59-793a-4364-b36f-3f10d3c8b29c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.845066] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "port-0f5b3f59-793a-4364-b36f-3f10d3c8b29c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.845207] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f5b3f59-793a-4364-b36f-3f10d3c8b29c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 775.925026] env[67094]: INFO networking_nsxv3.common.synchronization [None req-2c033e0d-df1d-4857-8034-26caacd9a145 None None] Enqueued Resource ID: ef35d004-6ab9-440f-b4b0-fb91536b4b93 with Priority: HIGHEST for action port [ 775.926024] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ef35d004-6ab9-440f-b4b0-fb91536b4b93 with Priority: HIGHEST for action port [ 775.926373] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-ef35d004-6ab9-440f-b4b0-fb91536b4b93 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 775.926533] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ef35d004-6ab9-440f-b4b0-fb91536b4b93" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 775.926627] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ef35d004-6ab9-440f-b4b0-fb91536b4b93" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 775.926941] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ef35d004-6ab9-440f-b4b0-fb91536b4b93" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 775.927093] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ef35d004-6ab9-440f-b4b0-fb91536b4b93',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.077154] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.077506] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.077506] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.077583] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.077679] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.077785] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 79476966-6948-4fb4-811c-c9f8cee63da2 is going to be updated. [ 776.119008] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.119572] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.119572] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.119572] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.119693] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.130918] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79476966-6948-4fb4-811c-c9f8cee63da2 in Status: IN_PROGRESS for 2s [ 776.349425] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.349425] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.349425] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.349425] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.349425] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.349425] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Segment Port 0f5b3f59-793a-4364-b36f-3f10d3c8b29c not found, creating... [ 776.349425] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.350351] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.350351] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.350351] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.350351] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.350351] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.350662] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.350662] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.350834] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.350903] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.351047] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Resource: SegmentPort with ID: 0f5b3f59-793a-4364-b36f-3f10d3c8b29c is going to be created. [ 776.373097] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.373351] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.373440] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.373700] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.374163] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.374163] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "port-0f5b3f59-793a-4364-b36f-3f10d3c8b29c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.426760] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 in Status: SUCCESS [ 776.427028] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.427262] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.427534] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.427890] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.428088] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.428220] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.428403] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.428536] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.428645] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.428745] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 776.432974] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ef35d004-6ab9-440f-b4b0-fb91536b4b93 [ 776.432974] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.432974] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.432974] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.432974] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.432974] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.432974] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ef35d004-6ab9-440f-b4b0-fb91536b4b93 already deleted. [ 776.433522] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ef35d004-6ab9-440f-b4b0-fb91536b4b93" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.875291] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 60943622-73b5-4dda-ad21-63bf08db617e in Status: SUCCESS [ 776.877051] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-60943622-73b5-4dda-ad21-63bf08db617e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.932556] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.935618] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.935618] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.935618] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.935618] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.935618] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.935618] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.935618] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.935618] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.935618] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.935618] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.935618] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.935618] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.935618] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.935618] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 776.935618] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 776.935618] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 776.935618] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 776.935618] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.936426] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 776.936426] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.099036] env[67094]: INFO networking_nsxv3.common.synchronization [req-3bfd99cc-e0b5-4027-8889-de04aab65309 req-18a34e7c-aff5-4cab-a115-d51eb5ab7bf6 service nova] Enqueued Resource ID: 79476966-6948-4fb4-811c-c9f8cee63da2 with Priority: HIGHEST for action security_group_rules [ 777.099036] env[67094]: INFO networking_nsxv3.common.synchronization [req-3bfd99cc-e0b5-4027-8889-de04aab65309 req-18a34e7c-aff5-4cab-a115-d51eb5ab7bf6 service nova] Enqueued Resource ID: 79476966-6948-4fb4-811c-c9f8cee63da2 with Priority: HIGHEST for action security_group_members [ 777.099036] env[67094]: INFO networking_nsxv3.common.synchronization [req-3bfd99cc-e0b5-4027-8889-de04aab65309 req-18a34e7c-aff5-4cab-a115-d51eb5ab7bf6 service nova] Enqueued Resource ID: 0f5b3f59-793a-4364-b36f-3f10d3c8b29c with Priority: HIGHEST for action port [ 777.099036] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79476966-6948-4fb4-811c-c9f8cee63da2 with Priority: HIGHEST for action security_group_rules [ 777.099036] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79476966-6948-4fb4-811c-c9f8cee63da2 with Priority: HIGHEST for action security_group_members [ 777.101074] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f5b3f59-793a-4364-b36f-3f10d3c8b29c with Priority: HIGHEST for action port [ 777.101074] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-79476966-6948-4fb4-811c-c9f8cee63da2 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.102783] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.102783] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.105027] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.105027] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('79476966-6948-4fb4-811c-c9f8cee63da2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.105027] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-79476966-6948-4fb4-811c-c9f8cee63da2 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.105027] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.105027] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-0f5b3f59-793a-4364-b36f-3f10d3c8b29c taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.105027] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0f5b3f59-793a-4364-b36f-3f10d3c8b29c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.105027] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0f5b3f59-793a-4364-b36f-3f10d3c8b29c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.105027] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0f5b3f59-793a-4364-b36f-3f10d3c8b29c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.105580] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f5b3f59-793a-4364-b36f-3f10d3c8b29c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.437400] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6: rpc.has_security_group_logging(os_id): False [ 777.457284] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.457429] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.457486] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.457704] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.457785] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.459535] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.459535] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.459535] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.459535] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.459535] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.459535] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.459535] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.459535] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.459535] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.459535] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.459919] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.459919] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.459919] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.460028] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.460196] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.460371] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 is going to be created. [ 777.524073] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.524478] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.524739] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.525534] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.527020] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.538512] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 in Status: IN_PROGRESS for 2s [ 777.609042] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-79476966-6948-4fb4-811c-c9f8cee63da2 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.609042] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.609205] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 0f5b3f59-793a-4364-b36f-3f10d3c8b29c with status ACTIVE [ 777.609277] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.611832] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.611832] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.611832] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.611832] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.611832] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.611832] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.611832] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.611832] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.611832] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.611832] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.611832] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.611832] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.611832] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.611832] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.611832] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 0f5b3f59-793a-4364-b36f-3f10d3c8b29c is going to be updated. [ 777.656482] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.656730] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.657100] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.659828] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.659828] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.659828] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0f5b3f59-793a-4364-b36f-3f10d3c8b29c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.755040] env[67094]: INFO networking_nsxv3.common.synchronization [req-ae3efb1b-b1d9-4c15-a56f-23a0b0dee128 req-cd888683-a979-4d43-98df-c8ac2aed4703 tempest-ServerGroupTestJSON-625213619 tempest-ServerGroupTestJSON-625213619-project-member] Enqueued Resource ID: c49f7fe8-62a6-4df5-90fb-465116c226a3 with Priority: HIGHEST for action security_group_members [ 777.755826] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c49f7fe8-62a6-4df5-90fb-465116c226a3 with Priority: HIGHEST for action security_group_members [ 777.756150] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-c49f7fe8-62a6-4df5-90fb-465116c226a3 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.756577] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c49f7fe8-62a6-4df5-90fb-465116c226a3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.756577] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c49f7fe8-62a6-4df5-90fb-465116c226a3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.756577] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c49f7fe8-62a6-4df5-90fb-465116c226a3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.757322] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.757322] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.757322] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.757322] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.757322] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 777.757577] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c49f7fe8-62a6-4df5-90fb-465116c226a3',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 777.958346] env[67094]: INFO networking_nsxv3.common.synchronization [None req-2d0e1b7c-d77d-4604-b514-118e70925cea None None] Enqueued Resource ID: 8b06ab3e-be12-40a7-99d5-b8c5c229fed6 with Priority: HIGHEST for action port [ 777.958973] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8b06ab3e-be12-40a7-99d5-b8c5c229fed6 with Priority: HIGHEST for action port [ 777.960077] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-8b06ab3e-be12-40a7-99d5-b8c5c229fed6 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 777.960077] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8b06ab3e-be12-40a7-99d5-b8c5c229fed6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 777.960077] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8b06ab3e-be12-40a7-99d5-b8c5c229fed6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 777.960505] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8b06ab3e-be12-40a7-99d5-b8c5c229fed6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 777.960505] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8b06ab3e-be12-40a7-99d5-b8c5c229fed6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.142859] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79476966-6948-4fb4-811c-c9f8cee63da2 in Status: SUCCESS [ 778.143208] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.143268] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.143506] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.143706] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.143818] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.143902] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.144081] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.144158] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.144249] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('79476966-6948-4fb4-811c-c9f8cee63da2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.159978] env[67094]: INFO networking_nsxv3.common.synchronization [None req-69110b7a-b712-47c6-aecc-8a21b187e631 None None] Enqueued Resource ID: 2bd6f3e4-3491-4623-ada6-fde9758803a1 with Priority: HIGHEST for action port [ 778.160699] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bd6f3e4-3491-4623-ada6-fde9758803a1 with Priority: HIGHEST for action port [ 778.160894] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-2bd6f3e4-3491-4623-ada6-fde9758803a1 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.161318] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2bd6f3e4-3491-4623-ada6-fde9758803a1" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.161424] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2bd6f3e4-3491-4623-ada6-fde9758803a1" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.161693] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2bd6f3e4-3491-4623-ada6-fde9758803a1" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.161775] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2bd6f3e4-3491-4623-ada6-fde9758803a1',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.191495] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock network-740 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.191697] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "network-740" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.191817] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "network-740" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.192291] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "network-740" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.192816] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.193433] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.193433] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.194121] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.194121] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.194322] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 778.194526] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 778.194705] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 778.194868] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 778.195033] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 778.195153] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 778.195330] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 778.220296] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 778.220499] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 778.220634] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 778.220806] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "network-740" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.221352] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock port-7354466c-061a-4989-a2a7-d92abe209656 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.223212] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "port-7354466c-061a-4989-a2a7-d92abe209656" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.223212] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "port-7354466c-061a-4989-a2a7-d92abe209656" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.223212] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "port-7354466c-061a-4989-a2a7-d92abe209656" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.223212] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7354466c-061a-4989-a2a7-d92abe209656',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.261209] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.261209] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.261209] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.261209] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.261209] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.261209] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.261209] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.261449] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.261449] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.261505] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.261582] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c49f7fe8-62a6-4df5-90fb-465116c226a3 already deleted. [ 778.261652] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c49f7fe8-62a6-4df5-90fb-465116c226a3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.464214] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8b06ab3e-be12-40a7-99d5-b8c5c229fed6 [ 778.464496] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.464638] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.464710] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.464928] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.465028] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.465128] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8b06ab3e-be12-40a7-99d5-b8c5c229fed6 already deleted. [ 778.465214] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8b06ab3e-be12-40a7-99d5-b8c5c229fed6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.646409] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('79476966-6948-4fb4-811c-c9f8cee63da2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 778.665036] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2bd6f3e4-3491-4623-ada6-fde9758803a1 [ 778.665257] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.665345] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.665413] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.665616] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.665705] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.665799] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2bd6f3e4-3491-4623-ada6-fde9758803a1 already deleted. [ 778.665913] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2bd6f3e4-3491-4623-ada6-fde9758803a1" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.726123] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.726356] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.726474] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.726742] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.726878] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.727104] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Segment Port 7354466c-061a-4989-a2a7-d92abe209656 not found, creating... [ 778.727298] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.727448] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.727559] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.727766] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.727940] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.728273] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.728454] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.728588] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.728795] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.728954] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.729096] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Resource: SegmentPort with ID: 7354466c-061a-4989-a2a7-d92abe209656 is going to be created. [ 778.748795] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 778.749089] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 778.749223] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 778.749543] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 778.749771] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 778.749985] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "port-7354466c-061a-4989-a2a7-d92abe209656" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.148236] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('79476966-6948-4fb4-811c-c9f8cee63da2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.509181] env[67094]: INFO networking_nsxv3.common.synchronization [req-ae3efb1b-b1d9-4c15-a56f-23a0b0dee128 req-bd9fa3d9-974e-48e1-91ac-4ff822322b38 service nova] Enqueued Resource ID: c49f7fe8-62a6-4df5-90fb-465116c226a3 with Priority: HIGHEST for action security_group_rules [ 779.509181] env[67094]: INFO networking_nsxv3.common.synchronization [req-ae3efb1b-b1d9-4c15-a56f-23a0b0dee128 req-bd9fa3d9-974e-48e1-91ac-4ff822322b38 service nova] Enqueued Resource ID: c49f7fe8-62a6-4df5-90fb-465116c226a3 with Priority: HIGHEST for action security_group_members [ 779.509181] env[67094]: INFO networking_nsxv3.common.synchronization [req-ae3efb1b-b1d9-4c15-a56f-23a0b0dee128 req-bd9fa3d9-974e-48e1-91ac-4ff822322b38 service nova] Enqueued Resource ID: 7354466c-061a-4989-a2a7-d92abe209656 with Priority: HIGHEST for action port [ 779.509181] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c49f7fe8-62a6-4df5-90fb-465116c226a3 with Priority: HIGHEST for action security_group_rules [ 779.509181] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c49f7fe8-62a6-4df5-90fb-465116c226a3 with Priority: HIGHEST for action security_group_members [ 779.509181] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7354466c-061a-4989-a2a7-d92abe209656 with Priority: HIGHEST for action port [ 779.509181] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c49f7fe8-62a6-4df5-90fb-465116c226a3 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.509181] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c49f7fe8-62a6-4df5-90fb-465116c226a3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.509181] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c49f7fe8-62a6-4df5-90fb-465116c226a3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.510215] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c49f7fe8-62a6-4df5-90fb-465116c226a3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.510480] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c49f7fe8-62a6-4df5-90fb-465116c226a3',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.511657] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-c49f7fe8-62a6-4df5-90fb-465116c226a3 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.511938] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c49f7fe8-62a6-4df5-90fb-465116c226a3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.512133] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c49f7fe8-62a6-4df5-90fb-465116c226a3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.512501] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c49f7fe8-62a6-4df5-90fb-465116c226a3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.512766] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.512990] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.513163] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.514594] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.514594] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.514594] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c49f7fe8-62a6-4df5-90fb-465116c226a3',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.515634] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-7354466c-061a-4989-a2a7-d92abe209656 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.515926] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7354466c-061a-4989-a2a7-d92abe209656" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.516130] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7354466c-061a-4989-a2a7-d92abe209656" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.516381] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7354466c-061a-4989-a2a7-d92abe209656" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.516567] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7354466c-061a-4989-a2a7-d92abe209656',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 779.553331] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 in Status: SUCCESS [ 779.553331] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.651584] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.651584] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.651584] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.651584] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.651584] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.651584] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 79476966-6948-4fb4-811c-c9f8cee63da2 is going to be updated. [ 779.691839] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.692055] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.692345] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.692555] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.692883] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.707136] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79476966-6948-4fb4-811c-c9f8cee63da2 in Status: IN_PROGRESS for 2s [ 779.862459] env[67094]: INFO networking_nsxv3.common.synchronization [req-219963ec-eb32-488f-9a82-07d3f07cd694 req-7dfa936c-9823-481b-8479-71b22015aed3 tempest-ServerRescueTestJSONUnderV235-1264300176 tempest-ServerRescueTestJSONUnderV235-1264300176-project-member] Enqueued Resource ID: a685dbf9-8823-4364-9677-e8aff5bd2a59 with Priority: HIGHEST for action security_group_members [ 779.863274] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a685dbf9-8823-4364-9677-e8aff5bd2a59 with Priority: HIGHEST for action security_group_members [ 779.864710] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-a685dbf9-8823-4364-9677-e8aff5bd2a59 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.864887] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.864970] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.865245] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.865412] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 779.865514] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 779.865578] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 779.865746] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 779.865833] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 779.865967] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a685dbf9-8823-4364-9677-e8aff5bd2a59',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.018884] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c49f7fe8-62a6-4df5-90fb-465116c226a3',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.019980] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-c49f7fe8-62a6-4df5-90fb-465116c226a3 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.020119] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c49f7fe8-62a6-4df5-90fb-465116c226a3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.020809] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 7354466c-061a-4989-a2a7-d92abe209656 with status ACTIVE [ 780.020991] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.021712] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.021712] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.021712] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.021712] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.021712] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.021712] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.021985] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.021985] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.021985] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.022211] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.022336] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.022431] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.022617] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.022737] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.022831] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 7354466c-061a-4989-a2a7-d92abe209656 is going to be updated. [ 780.051662] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.051862] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.051947] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.052301] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.052418] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.052645] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7354466c-061a-4989-a2a7-d92abe209656" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.313534] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock network-859 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.313919] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "network-859" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.314303] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "network-859" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.315525] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "network-859" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.315525] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.315525] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.315525] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.315525] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.315829] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.316122] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 780.316253] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 780.316369] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 780.316631] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 780.316716] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 780.316774] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 780.317094] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 780.365653] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 780.365853] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Cache value generated in 0.049 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 780.365986] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 780.366194] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "network-859" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.366546] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock port-07fc003d-db88-433f-85c3-0e029148a6c3 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.366715] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "port-07fc003d-db88-433f-85c3-0e029148a6c3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.366830] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "port-07fc003d-db88-433f-85c3-0e029148a6c3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.367261] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "port-07fc003d-db88-433f-85c3-0e029148a6c3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.367400] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('07fc003d-db88-433f-85c3-0e029148a6c3',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.369091] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.369308] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.369389] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.369596] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.369689] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.369898] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.370009] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.370081] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.370259] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.370343] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.370430] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a685dbf9-8823-4364-9677-e8aff5bd2a59 already deleted. [ 780.370511] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.521232] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c49f7fe8-62a6-4df5-90fb-465116c226a3',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.814700] env[67094]: INFO networking_nsxv3.common.synchronization [None req-a0cc6da2-6b0c-4434-ac41-577e235b1754 None None] Enqueued Resource ID: 3be8ec9a-9656-494b-b867-0505a57f5265 with Priority: HIGHEST for action port [ 780.815401] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3be8ec9a-9656-494b-b867-0505a57f5265 with Priority: HIGHEST for action port [ 780.815841] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-3be8ec9a-9656-494b-b867-0505a57f5265 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.816024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3be8ec9a-9656-494b-b867-0505a57f5265" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.816123] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3be8ec9a-9656-494b-b867-0505a57f5265" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.816407] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3be8ec9a-9656-494b-b867-0505a57f5265" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.816537] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3be8ec9a-9656-494b-b867-0505a57f5265',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.853061] env[67094]: INFO networking_nsxv3.common.synchronization [None req-8a993d7f-c11d-4e39-838c-844e42c0df60 tempest-ServerActionsTestOtherA-276518123 tempest-ServerActionsTestOtherA-276518123-project-member] Enqueued Resource ID: 005d1062-21f3-48fc-b7a0-06c9f0fc7843 with Priority: HIGHEST for action security_group_rules [ 780.853534] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 005d1062-21f3-48fc-b7a0-06c9f0fc7843 with Priority: HIGHEST for action security_group_rules [ 780.854031] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-005d1062-21f3-48fc-b7a0-06c9f0fc7843 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.854148] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-005d1062-21f3-48fc-b7a0-06c9f0fc7843" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.854850] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-005d1062-21f3-48fc-b7a0-06c9f0fc7843" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.854850] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-005d1062-21f3-48fc-b7a0-06c9f0fc7843" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.854850] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('005d1062-21f3-48fc-b7a0-06c9f0fc7843',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 780.871862] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.872313] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.872313] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.872594] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.872739] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.872899] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Segment Port 07fc003d-db88-433f-85c3-0e029148a6c3 not found, creating... [ 780.873166] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.873336] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.873481] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.873702] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.873926] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.874387] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.874548] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.874661] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.874898] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.875102] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.875183] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Resource: SegmentPort with ID: 07fc003d-db88-433f-85c3-0e029148a6c3 is going to be created. [ 780.896359] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.896518] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 780.896655] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 780.896924] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 780.897192] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.897466] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "port-07fc003d-db88-433f-85c3-0e029148a6c3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 780.960516] env[67094]: INFO networking_nsxv3.common.synchronization [None req-027c319a-947b-4672-868b-a931c34d5e23 tempest-ServerActionsTestOtherA-276518123 tempest-ServerActionsTestOtherA-276518123-project-member] Enqueued Resource ID: 005d1062-21f3-48fc-b7a0-06c9f0fc7843 with Priority: HIGHEST for action security_group_rules [ 780.961061] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 005d1062-21f3-48fc-b7a0-06c9f0fc7843 with Priority: HIGHEST for action security_group_rules [ 780.961344] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-005d1062-21f3-48fc-b7a0-06c9f0fc7843 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 780.961446] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-005d1062-21f3-48fc-b7a0-06c9f0fc7843" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.023781] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.023954] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.024058] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.024253] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.024558] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.024558] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c49f7fe8-62a6-4df5-90fb-465116c226a3 is going to be created. [ 781.055508] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.055820] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.055905] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.056413] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.056488] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.070020] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c49f7fe8-62a6-4df5-90fb-465116c226a3 in Status: UNINITIALIZED for 2s [ 781.318844] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3be8ec9a-9656-494b-b867-0505a57f5265 [ 781.319227] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.319315] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.319419] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.319670] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.319948] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.319948] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3be8ec9a-9656-494b-b867-0505a57f5265 already deleted. [ 781.319948] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3be8ec9a-9656-494b-b867-0505a57f5265" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.385749] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.385987] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.386129] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.386397] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.386512] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.386616] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 005d1062-21f3-48fc-b7a0-06c9f0fc7843 already deleted. [ 781.386739] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-005d1062-21f3-48fc-b7a0-06c9f0fc7843" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.386974] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-005d1062-21f3-48fc-b7a0-06c9f0fc7843" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.387196] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-005d1062-21f3-48fc-b7a0-06c9f0fc7843" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.387308] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('005d1062-21f3-48fc-b7a0-06c9f0fc7843',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.648653] env[67094]: INFO networking_nsxv3.common.synchronization [req-219963ec-eb32-488f-9a82-07d3f07cd694 req-676b37dc-e3eb-4c37-84d3-cbda8a02619f service nova] Enqueued Resource ID: a685dbf9-8823-4364-9677-e8aff5bd2a59 with Priority: HIGHEST for action security_group_rules [ 781.648855] env[67094]: INFO networking_nsxv3.common.synchronization [req-219963ec-eb32-488f-9a82-07d3f07cd694 req-676b37dc-e3eb-4c37-84d3-cbda8a02619f service nova] Enqueued Resource ID: a685dbf9-8823-4364-9677-e8aff5bd2a59 with Priority: HIGHEST for action security_group_members [ 781.648955] env[67094]: INFO networking_nsxv3.common.synchronization [req-219963ec-eb32-488f-9a82-07d3f07cd694 req-676b37dc-e3eb-4c37-84d3-cbda8a02619f service nova] Enqueued Resource ID: 07fc003d-db88-433f-85c3-0e029148a6c3 with Priority: HIGHEST for action port [ 781.649578] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a685dbf9-8823-4364-9677-e8aff5bd2a59 with Priority: HIGHEST for action security_group_rules [ 781.649724] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a685dbf9-8823-4364-9677-e8aff5bd2a59 with Priority: HIGHEST for action security_group_members [ 781.649821] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07fc003d-db88-433f-85c3-0e029148a6c3 with Priority: HIGHEST for action port [ 781.650249] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a685dbf9-8823-4364-9677-e8aff5bd2a59 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.651218] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.651218] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.651218] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.651218] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a685dbf9-8823-4364-9677-e8aff5bd2a59',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.652687] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-a685dbf9-8823-4364-9677-e8aff5bd2a59 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.652687] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.658289] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.658289] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.658289] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.658289] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.658289] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.658289] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.658289] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.658289] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a685dbf9-8823-4364-9677-e8aff5bd2a59',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.658289] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-07fc003d-db88-433f-85c3-0e029148a6c3 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.658289] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-07fc003d-db88-433f-85c3-0e029148a6c3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.658289] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-07fc003d-db88-433f-85c3-0e029148a6c3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.658289] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-07fc003d-db88-433f-85c3-0e029148a6c3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.658289] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('07fc003d-db88-433f-85c3-0e029148a6c3',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.722670] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79476966-6948-4fb4-811c-c9f8cee63da2 in Status: SUCCESS [ 781.722670] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.722670] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.722670] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.722670] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.722670] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.722670] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.722670] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.722670] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.722670] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.722670] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('79476966-6948-4fb4-811c-c9f8cee63da2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 781.912914] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 781.912914] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 781.912914] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 781.912914] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 781.912914] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 781.912914] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 005d1062-21f3-48fc-b7a0-06c9f0fc7843 already deleted. [ 781.912914] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-005d1062-21f3-48fc-b7a0-06c9f0fc7843" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.083789] env[67094]: INFO networking_nsxv3.common.synchronization [req-007ccf53-c579-415b-9037-28aaa9c2d0d0 req-5f84f258-a3eb-4e4f-9426-3739e00aa68c tempest-SecurityGroupsTestJSON-1233321301 tempest-SecurityGroupsTestJSON-1233321301-project-member] Enqueued Resource ID: 763488f4-7445-4094-9732-5af84c8ba064 with Priority: HIGHEST for action security_group_members [ 782.083789] env[67094]: INFO networking_nsxv3.common.synchronization [req-007ccf53-c579-415b-9037-28aaa9c2d0d0 req-5f84f258-a3eb-4e4f-9426-3739e00aa68c tempest-SecurityGroupsTestJSON-1233321301 tempest-SecurityGroupsTestJSON-1233321301-project-member] Enqueued Resource ID: f7861002-4b91-437c-8519-9140d1a3bd82 with Priority: HIGHEST for action security_group_members [ 782.084703] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 763488f4-7445-4094-9732-5af84c8ba064 with Priority: HIGHEST for action security_group_members [ 782.084901] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7861002-4b91-437c-8519-9140d1a3bd82 with Priority: HIGHEST for action security_group_members [ 782.085381] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-763488f4-7445-4094-9732-5af84c8ba064 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.085569] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-763488f4-7445-4094-9732-5af84c8ba064" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.085662] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-763488f4-7445-4094-9732-5af84c8ba064" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.085991] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-763488f4-7445-4094-9732-5af84c8ba064" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.086261] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.086376] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.086442] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.086711] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.086860] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.086972] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('763488f4-7445-4094-9732-5af84c8ba064',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.090072] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7861002-4b91-437c-8519-9140d1a3bd82 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.090379] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.090482] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.090731] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.090913] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.091193] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.091370] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.091519] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.091668] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.091809] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7861002-4b91-437c-8519-9140d1a3bd82',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.143249] env[67094]: INFO networking_nsxv3.common.synchronization [req-007ccf53-c579-415b-9037-28aaa9c2d0d0 req-5f84f258-a3eb-4e4f-9426-3739e00aa68c tempest-SecurityGroupsTestJSON-1233321301 tempest-SecurityGroupsTestJSON-1233321301-project-member] Enqueued Resource ID: 763488f4-7445-4094-9732-5af84c8ba064 with Priority: HIGHEST for action security_group_rules [ 782.143249] env[67094]: INFO networking_nsxv3.common.synchronization [req-007ccf53-c579-415b-9037-28aaa9c2d0d0 req-5f84f258-a3eb-4e4f-9426-3739e00aa68c tempest-SecurityGroupsTestJSON-1233321301 tempest-SecurityGroupsTestJSON-1233321301-project-member] Enqueued Resource ID: 763488f4-7445-4094-9732-5af84c8ba064 with Priority: HIGHEST for action security_group_members [ 782.143249] env[67094]: INFO networking_nsxv3.common.synchronization [req-007ccf53-c579-415b-9037-28aaa9c2d0d0 req-5f84f258-a3eb-4e4f-9426-3739e00aa68c tempest-SecurityGroupsTestJSON-1233321301 tempest-SecurityGroupsTestJSON-1233321301-project-member] Enqueued Resource ID: f7861002-4b91-437c-8519-9140d1a3bd82 with Priority: HIGHEST for action security_group_rules [ 782.143249] env[67094]: INFO networking_nsxv3.common.synchronization [req-007ccf53-c579-415b-9037-28aaa9c2d0d0 req-5f84f258-a3eb-4e4f-9426-3739e00aa68c tempest-SecurityGroupsTestJSON-1233321301 tempest-SecurityGroupsTestJSON-1233321301-project-member] Enqueued Resource ID: f7861002-4b91-437c-8519-9140d1a3bd82 with Priority: HIGHEST for action security_group_members [ 782.143249] env[67094]: INFO networking_nsxv3.common.synchronization [req-007ccf53-c579-415b-9037-28aaa9c2d0d0 req-5f84f258-a3eb-4e4f-9426-3739e00aa68c tempest-SecurityGroupsTestJSON-1233321301 tempest-SecurityGroupsTestJSON-1233321301-project-member] Enqueued Resource ID: dbaea447-eb60-4d7b-b784-b8cea012726a with Priority: HIGHEST for action port [ 782.146136] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 763488f4-7445-4094-9732-5af84c8ba064 with Priority: HIGHEST for action security_group_rules [ 782.146467] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7861002-4b91-437c-8519-9140d1a3bd82 with Priority: HIGHEST for action security_group_rules [ 782.146686] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbaea447-eb60-4d7b-b784-b8cea012726a with Priority: HIGHEST for action port [ 782.146877] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 763488f4-7445-4094-9732-5af84c8ba064 with Priority: HIGHEST for action security_group_members [ 782.147077] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7861002-4b91-437c-8519-9140d1a3bd82 with Priority: HIGHEST for action security_group_members [ 782.147542] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-763488f4-7445-4094-9732-5af84c8ba064 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.147815] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-763488f4-7445-4094-9732-5af84c8ba064" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.148079] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-763488f4-7445-4094-9732-5af84c8ba064" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.148452] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-763488f4-7445-4094-9732-5af84c8ba064" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.148632] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('763488f4-7445-4094-9732-5af84c8ba064',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.150079] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f7861002-4b91-437c-8519-9140d1a3bd82 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.150079] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.150079] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.150260] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.150260] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f7861002-4b91-437c-8519-9140d1a3bd82',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.151066] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-dbaea447-eb60-4d7b-b784-b8cea012726a taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.151744] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dbaea447-eb60-4d7b-b784-b8cea012726a" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.151744] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dbaea447-eb60-4d7b-b784-b8cea012726a" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.151744] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dbaea447-eb60-4d7b-b784-b8cea012726a" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.151744] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dbaea447-eb60-4d7b-b784-b8cea012726a',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.153033] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-763488f4-7445-4094-9732-5af84c8ba064 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.153033] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-763488f4-7445-4094-9732-5af84c8ba064" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.153033] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7861002-4b91-437c-8519-9140d1a3bd82 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.153033] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.153469] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-a685dbf9-8823-4364-9677-e8aff5bd2a59 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.153555] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.159821] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 07fc003d-db88-433f-85c3-0e029148a6c3 with status ACTIVE [ 782.160029] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.160191] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.160266] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.160603] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.160828] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.161109] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.161253] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.161335] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.161506] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.161587] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.161885] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.161885] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.162011] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.162265] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.162265] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.162265] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 07fc003d-db88-433f-85c3-0e029148a6c3 is going to be updated. [ 782.163331] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a685dbf9-8823-4364-9677-e8aff5bd2a59',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.188333] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.188333] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.188333] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.188624] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.188702] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.188929] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-07fc003d-db88-433f-85c3-0e029148a6c3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.225053] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-79476966-6948-4fb4-811c-c9f8cee63da2 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.225244] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.225402] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.225615] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.225877] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.226026] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.226105] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.226323] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.226435] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.226545] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.226754] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-79476966-6948-4fb4-811c-c9f8cee63da2 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.226877] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.226944] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.227159] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.227342] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.227452] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.227541] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.228137] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.228137] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.228137] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.228137] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('79476966-6948-4fb4-811c-c9f8cee63da2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.594448] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('763488f4-7445-4094-9732-5af84c8ba064',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.598660] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f7861002-4b91-437c-8519-9140d1a3bd82',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.653524] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7861002-4b91-437c-8519-9140d1a3bd82 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.653708] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.653916] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dbaea447-eb60-4d7b-b784-b8cea012726a with status ACTIVE [ 782.653962] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.654084] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.654150] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.654355] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.654435] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.654611] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.654706] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.654769] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.654926] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.655012] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.655206] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.655288] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.655350] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.655483] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.655552] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.655640] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dbaea447-eb60-4d7b-b784-b8cea012726a is going to be updated. [ 782.656980] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-763488f4-7445-4094-9732-5af84c8ba064 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.657152] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-763488f4-7445-4094-9732-5af84c8ba064" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.666070] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a685dbf9-8823-4364-9677-e8aff5bd2a59',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.679516] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.679703] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.679703] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.680085] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.680304] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.680477] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dbaea447-eb60-4d7b-b784-b8cea012726a" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.718901] env[67094]: INFO networking_nsxv3.common.synchronization [req-9435621c-c319-4ebe-8095-e4391bc975d1 req-c7d1f725-c79e-4660-a0a0-185beaea1070 tempest-AttachInterfacesTestJSON-1117082489 tempest-AttachInterfacesTestJSON-1117082489-project-member] Enqueued Resource ID: 882c69d3-9554-45c6-97a1-55fb0f065040 with Priority: HIGHEST for action security_group_members [ 782.720619] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 882c69d3-9554-45c6-97a1-55fb0f065040 with Priority: HIGHEST for action security_group_members [ 782.724019] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-882c69d3-9554-45c6-97a1-55fb0f065040 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.724019] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.724019] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.724019] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.724019] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.724019] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.724019] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.724019] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.724019] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.724019] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('882c69d3-9554-45c6-97a1-55fb0f065040',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 782.731971] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 79476966-6948-4fb4-811c-c9f8cee63da2: rpc.has_security_group_logging(os_id): False [ 782.751435] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.751629] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.751674] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.752136] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.752136] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.752325] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.752408] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.752877] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.752877] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.752877] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.752877] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.753077] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.753151] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.753803] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.753803] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.753803] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.753803] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.753993] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.754101] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.754348] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.754348] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 79476966-6948-4fb4-811c-c9f8cee63da2 is going to be updated. [ 782.866434] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 782.866646] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 782.866646] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 782.866894] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 782.867076] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 782.893403] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 79476966-6948-4fb4-811c-c9f8cee63da2 in Status: IN_PROGRESS for 2s [ 783.081869] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c49f7fe8-62a6-4df5-90fb-465116c226a3 in Status: SUCCESS [ 783.082202] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c49f7fe8-62a6-4df5-90fb-465116c226a3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.083189] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c49f7fe8-62a6-4df5-90fb-465116c226a3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.083189] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c49f7fe8-62a6-4df5-90fb-465116c226a3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.083189] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.083189] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.083189] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.083189] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.083401] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.083401] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c49f7fe8-62a6-4df5-90fb-465116c226a3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.083401] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c49f7fe8-62a6-4df5-90fb-465116c226a3',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.097321] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('763488f4-7445-4094-9732-5af84c8ba064',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.097675] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f7861002-4b91-437c-8519-9140d1a3bd82',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.116934] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock network-766 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.116934] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "network-766" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.116934] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "network-766" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.116934] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "network-766" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.116934] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.118714] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.119728] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.119728] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.120184] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.120184] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 783.120251] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 783.120305] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 783.120443] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 783.120507] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 783.120898] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 783.120898] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 783.148968] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 783.149214] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 783.149352] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 783.149521] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "network-766" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.151021] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock port-c371bf23-f965-4a99-b6de-92b819a6bebe taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.151150] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "port-c371bf23-f965-4a99-b6de-92b819a6bebe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.151370] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "port-c371bf23-f965-4a99-b6de-92b819a6bebe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.151779] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "port-c371bf23-f965-4a99-b6de-92b819a6bebe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.151918] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c371bf23-f965-4a99-b6de-92b819a6bebe',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.169165] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.169547] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.169547] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.170279] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.170279] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.170279] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a685dbf9-8823-4364-9677-e8aff5bd2a59 is going to be created. [ 783.199843] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.200218] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.200218] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.200314] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.200496] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.433046] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.433046] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.433046] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.433046] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.433046] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.433046] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.433046] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.433046] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.433046] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.433046] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.433046] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 882c69d3-9554-45c6-97a1-55fb0f065040 already deleted. [ 783.433046] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.433772] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a685dbf9-8823-4364-9677-e8aff5bd2a59 in Status: UNINITIALIZED for 2s [ 783.586606] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-c49f7fe8-62a6-4df5-90fb-465116c226a3 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.586775] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c49f7fe8-62a6-4df5-90fb-465116c226a3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.586868] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c49f7fe8-62a6-4df5-90fb-465116c226a3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.587110] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c49f7fe8-62a6-4df5-90fb-465116c226a3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.587285] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.587399] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.587496] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.587617] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.587704] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.587997] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c49f7fe8-62a6-4df5-90fb-465116c226a3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.587997] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-c49f7fe8-62a6-4df5-90fb-465116c226a3 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.588132] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c49f7fe8-62a6-4df5-90fb-465116c226a3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.588132] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c49f7fe8-62a6-4df5-90fb-465116c226a3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.588819] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c49f7fe8-62a6-4df5-90fb-465116c226a3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.588819] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.588819] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.588819] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.588819] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.588819] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.588819] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c49f7fe8-62a6-4df5-90fb-465116c226a3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.589199] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c49f7fe8-62a6-4df5-90fb-465116c226a3',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.597679] env[67094]: INFO networking_nsxv3.common.synchronization [req-cdcdcefd-373b-4c74-bbc9-8a20a4c61d1c req-5fce93a8-96c1-4567-8e8b-4bd6d7b5d854 tempest-ImagesOneServerNegativeTestJSON-1967011174 tempest-ImagesOneServerNegativeTestJSON-1967011174-project-member] Enqueued Resource ID: 71aa8195-5281-4a1c-b9a7-3d40e851f47e with Priority: HIGHEST for action security_group_members [ 783.599705] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71aa8195-5281-4a1c-b9a7-3d40e851f47e with Priority: HIGHEST for action security_group_members [ 783.600163] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.600294] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.600607] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.600607] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.601708] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.601708] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 763488f4-7445-4094-9732-5af84c8ba064 is going to be created. [ 783.601949] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.602315] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.602443] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.602662] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.602803] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.602936] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7861002-4b91-437c-8519-9140d1a3bd82 is going to be updated. [ 783.604035] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-71aa8195-5281-4a1c-b9a7-3d40e851f47e taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.604191] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.604302] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.604531] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.605343] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.605343] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.605343] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.605343] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.605343] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.605343] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('71aa8195-5281-4a1c-b9a7-3d40e851f47e',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 783.632495] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.632495] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.632716] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.632750] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.632904] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.641496] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.641670] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.641761] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.642010] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.642516] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.645621] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 763488f4-7445-4094-9732-5af84c8ba064 in Status: UNINITIALIZED for 2s [ 783.651474] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7861002-4b91-437c-8519-9140d1a3bd82 in Status: IN_PROGRESS for 2s [ 783.655526] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.655933] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.656147] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.656516] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.656706] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.656889] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Segment Port c371bf23-f965-4a99-b6de-92b819a6bebe not found, creating... [ 783.657228] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.657436] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.657539] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.657792] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.658045] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.658414] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.658589] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.658734] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.659020] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.659222] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.659396] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Resource: SegmentPort with ID: c371bf23-f965-4a99-b6de-92b819a6bebe is going to be created. [ 783.683902] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.684102] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.684386] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.684386] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.684644] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.684791] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "port-c371bf23-f965-4a99-b6de-92b819a6bebe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 783.743819] env[67094]: INFO networking_nsxv3.common.synchronization [None req-a92e4f65-df9b-4383-aff0-7f10675d3c69 None None] Enqueued Resource ID: 5aa03690-15d7-4dd0-99ea-406dcd749233 with Priority: HIGHEST for action port [ 783.744235] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5aa03690-15d7-4dd0-99ea-406dcd749233 with Priority: HIGHEST for action port [ 783.744622] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-5aa03690-15d7-4dd0-99ea-406dcd749233 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 783.744714] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5aa03690-15d7-4dd0-99ea-406dcd749233" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 783.744784] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5aa03690-15d7-4dd0-99ea-406dcd749233" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 783.745049] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5aa03690-15d7-4dd0-99ea-406dcd749233" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 783.745136] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5aa03690-15d7-4dd0-99ea-406dcd749233',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.093052] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c49f7fe8-62a6-4df5-90fb-465116c226a3: rpc.has_security_group_logging(os_id): False [ 784.108490] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.108490] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.108490] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.108719] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.108804] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.109017] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.109203] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.109270] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.109432] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.109538] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.109596] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71aa8195-5281-4a1c-b9a7-3d40e851f47e is going to be updated. [ 784.112730] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.112909] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.112909] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.113096] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.113233] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.113427] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.113527] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.113583] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.113740] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.113812] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.113998] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.114111] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.114173] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.114390] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.114390] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.114613] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.114782] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.114900] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.115609] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.115609] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.115609] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c49f7fe8-62a6-4df5-90fb-465116c226a3 is going to be created. [ 784.148108] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.148108] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.148108] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.148331] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.148477] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.157547] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71aa8195-5281-4a1c-b9a7-3d40e851f47e in Status: IN_PROGRESS for 2s [ 784.207216] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.207216] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.207216] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.207216] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.207216] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.223065] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c49f7fe8-62a6-4df5-90fb-465116c226a3 in Status: IN_PROGRESS for 2s [ 784.249020] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 5aa03690-15d7-4dd0-99ea-406dcd749233 [ 784.249020] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.249020] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.249271] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.249368] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.249414] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.249510] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:5aa03690-15d7-4dd0-99ea-406dcd749233 already deleted. [ 784.249604] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5aa03690-15d7-4dd0-99ea-406dcd749233" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.441814] env[67094]: INFO networking_nsxv3.common.synchronization [req-9435621c-c319-4ebe-8095-e4391bc975d1 req-1e2bd60c-cbfb-4b75-8589-25341434fc33 service nova] Enqueued Resource ID: 882c69d3-9554-45c6-97a1-55fb0f065040 with Priority: HIGHEST for action security_group_rules [ 784.441917] env[67094]: INFO networking_nsxv3.common.synchronization [req-9435621c-c319-4ebe-8095-e4391bc975d1 req-1e2bd60c-cbfb-4b75-8589-25341434fc33 service nova] Enqueued Resource ID: 882c69d3-9554-45c6-97a1-55fb0f065040 with Priority: HIGHEST for action security_group_members [ 784.442194] env[67094]: INFO networking_nsxv3.common.synchronization [req-9435621c-c319-4ebe-8095-e4391bc975d1 req-1e2bd60c-cbfb-4b75-8589-25341434fc33 service nova] Enqueued Resource ID: c371bf23-f965-4a99-b6de-92b819a6bebe with Priority: HIGHEST for action port [ 784.443128] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 882c69d3-9554-45c6-97a1-55fb0f065040 with Priority: HIGHEST for action security_group_rules [ 784.443128] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 882c69d3-9554-45c6-97a1-55fb0f065040 with Priority: HIGHEST for action security_group_members [ 784.443128] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c371bf23-f965-4a99-b6de-92b819a6bebe with Priority: HIGHEST for action port [ 784.444407] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-882c69d3-9554-45c6-97a1-55fb0f065040 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.445100] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.445156] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.445469] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.445601] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('882c69d3-9554-45c6-97a1-55fb0f065040',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.446641] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-882c69d3-9554-45c6-97a1-55fb0f065040 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.446746] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.446788] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.446976] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.448185] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.451074] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.451074] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.451074] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.451074] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.451074] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('882c69d3-9554-45c6-97a1-55fb0f065040',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.451074] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-c371bf23-f965-4a99-b6de-92b819a6bebe taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.451074] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c371bf23-f965-4a99-b6de-92b819a6bebe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.451074] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c371bf23-f965-4a99-b6de-92b819a6bebe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.451074] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c371bf23-f965-4a99-b6de-92b819a6bebe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.451074] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c371bf23-f965-4a99-b6de-92b819a6bebe',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.910462] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 79476966-6948-4fb4-811c-c9f8cee63da2 in Status: SUCCESS [ 784.910462] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.951587] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-882c69d3-9554-45c6-97a1-55fb0f065040 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.951804] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.955185] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('882c69d3-9554-45c6-97a1-55fb0f065040',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 784.955185] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c371bf23-f965-4a99-b6de-92b819a6bebe with status ACTIVE [ 784.955185] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.955185] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.955185] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.955185] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.955185] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.955185] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.955758] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.955878] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.956099] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.956703] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.956918] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.957040] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.957104] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.957260] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.957337] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.958180] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c371bf23-f965-4a99-b6de-92b819a6bebe is going to be updated. [ 784.981958] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 784.982193] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 784.982931] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 784.982931] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 784.982931] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 784.983075] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c371bf23-f965-4a99-b6de-92b819a6bebe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.194759] env[67094]: INFO networking_nsxv3.common.synchronization [req-53f15065-d85e-4987-8c2c-dbc20b321805 req-39112895-da76-439a-8c81-77eae5e0b666 tempest-SecurityGroupRulesNegativeTestJSON-997979899 tempest-SecurityGroupRulesNegativeTestJSON-997979899-project-member] Enqueued Resource ID: 912f26d1-3a28-4efe-a036-9d3538e2a931 with Priority: HIGHEST for action security_group_rules [ 785.195710] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 912f26d1-3a28-4efe-a036-9d3538e2a931 with Priority: HIGHEST for action security_group_rules [ 785.196081] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-912f26d1-3a28-4efe-a036-9d3538e2a931 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.196209] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-912f26d1-3a28-4efe-a036-9d3538e2a931" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.196277] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-912f26d1-3a28-4efe-a036-9d3538e2a931" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.196609] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-912f26d1-3a28-4efe-a036-9d3538e2a931" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.196609] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('912f26d1-3a28-4efe-a036-9d3538e2a931',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.446103] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a685dbf9-8823-4364-9677-e8aff5bd2a59 in Status: SUCCESS [ 785.446103] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.446103] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.446280] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.446501] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.446622] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.446688] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.446843] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.446923] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.447020] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.447140] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a685dbf9-8823-4364-9677-e8aff5bd2a59',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.459977] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('882c69d3-9554-45c6-97a1-55fb0f065040',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.547581] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.549765] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.549765] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.549765] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.549765] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.659272] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 763488f4-7445-4094-9732-5af84c8ba064 in Status: SUCCESS [ 785.660835] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-763488f4-7445-4094-9732-5af84c8ba064" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.661145] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-763488f4-7445-4094-9732-5af84c8ba064" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.661400] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-763488f4-7445-4094-9732-5af84c8ba064" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.661861] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.662898] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.662898] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.662898] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.662898] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.662898] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('763488f4-7445-4094-9732-5af84c8ba064',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.664777] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7861002-4b91-437c-8519-9140d1a3bd82 in Status: SUCCESS [ 785.664988] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.665176] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.665350] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.665522] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.665634] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.665725] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.665852] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.665961] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.666038] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7861002-4b91-437c-8519-9140d1a3bd82',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.718812] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.719083] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.719083] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.719628] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.719628] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.719628] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 912f26d1-3a28-4efe-a036-9d3538e2a931 already deleted. [ 785.719628] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-912f26d1-3a28-4efe-a036-9d3538e2a931" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.951340] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-a685dbf9-8823-4364-9677-e8aff5bd2a59 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.951340] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.951340] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.951340] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.951340] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.951340] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.951340] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.951935] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.951935] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.952102] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.952362] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-a685dbf9-8823-4364-9677-e8aff5bd2a59 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.952483] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.952549] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.952701] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.952841] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.952933] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.953008] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.953151] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.953231] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.953328] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.953393] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a685dbf9-8823-4364-9677-e8aff5bd2a59',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 785.961984] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.962131] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.962170] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.962355] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.962440] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 785.962538] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 882c69d3-9554-45c6-97a1-55fb0f065040 is going to be created. [ 785.988663] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 785.988877] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 785.988877] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 785.989243] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 785.989468] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.000880] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882c69d3-9554-45c6-97a1-55fb0f065040 in Status: UNINITIALIZED for 2s [ 786.050106] env[67094]: INFO networking_nsxv3.common.synchronization [req-832b20fd-8465-4791-a206-51d31d12f3ad req-e02bd795-89be-40f8-9d9d-89d06a92ebe1 tempest-SecurityGroupsTestJSON-1233321301 tempest-SecurityGroupsTestJSON-1233321301-project-member] Enqueued Resource ID: 763488f4-7445-4094-9732-5af84c8ba064 with Priority: HIGHEST for action security_group_members [ 786.050355] env[67094]: INFO networking_nsxv3.common.synchronization [req-832b20fd-8465-4791-a206-51d31d12f3ad req-e02bd795-89be-40f8-9d9d-89d06a92ebe1 tempest-SecurityGroupsTestJSON-1233321301 tempest-SecurityGroupsTestJSON-1233321301-project-member] Enqueued Resource ID: ae59884c-acbd-4c88-8cdb-fd8d14c95621 with Priority: HIGHEST for action security_group_members [ 786.050526] env[67094]: INFO networking_nsxv3.common.synchronization [req-832b20fd-8465-4791-a206-51d31d12f3ad req-e02bd795-89be-40f8-9d9d-89d06a92ebe1 tempest-SecurityGroupsTestJSON-1233321301 tempest-SecurityGroupsTestJSON-1233321301-project-member] Enqueued Resource ID: f7861002-4b91-437c-8519-9140d1a3bd82 with Priority: HIGHEST for action security_group_members [ 786.051457] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 763488f4-7445-4094-9732-5af84c8ba064 with Priority: HIGHEST for action security_group_members [ 786.051457] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae59884c-acbd-4c88-8cdb-fd8d14c95621 with Priority: HIGHEST for action security_group_members [ 786.051457] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7861002-4b91-437c-8519-9140d1a3bd82 with Priority: HIGHEST for action security_group_members [ 786.051655] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-763488f4-7445-4094-9732-5af84c8ba064 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.051703] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-763488f4-7445-4094-9732-5af84c8ba064" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.051957] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae59884c-acbd-4c88-8cdb-fd8d14c95621 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.052113] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae59884c-acbd-4c88-8cdb-fd8d14c95621" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.052221] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae59884c-acbd-4c88-8cdb-fd8d14c95621" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.052525] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae59884c-acbd-4c88-8cdb-fd8d14c95621" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.052730] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.052884] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.052944] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.053156] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.053252] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.053667] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae59884c-acbd-4c88-8cdb-fd8d14c95621',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.054250] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.055288] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7861002-4b91-437c-8519-9140d1a3bd82 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.055433] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.104674] env[67094]: INFO networking_nsxv3.common.synchronization [req-832b20fd-8465-4791-a206-51d31d12f3ad req-e02bd795-89be-40f8-9d9d-89d06a92ebe1 tempest-SecurityGroupsTestJSON-1233321301 tempest-SecurityGroupsTestJSON-1233321301-project-member] Enqueued Resource ID: 763488f4-7445-4094-9732-5af84c8ba064 with Priority: HIGHEST for action security_group_rules [ 786.104867] env[67094]: INFO networking_nsxv3.common.synchronization [req-832b20fd-8465-4791-a206-51d31d12f3ad req-e02bd795-89be-40f8-9d9d-89d06a92ebe1 tempest-SecurityGroupsTestJSON-1233321301 tempest-SecurityGroupsTestJSON-1233321301-project-member] Enqueued Resource ID: 763488f4-7445-4094-9732-5af84c8ba064 with Priority: HIGHEST for action security_group_members [ 786.105042] env[67094]: INFO networking_nsxv3.common.synchronization [req-832b20fd-8465-4791-a206-51d31d12f3ad req-e02bd795-89be-40f8-9d9d-89d06a92ebe1 tempest-SecurityGroupsTestJSON-1233321301 tempest-SecurityGroupsTestJSON-1233321301-project-member] Enqueued Resource ID: ae59884c-acbd-4c88-8cdb-fd8d14c95621 with Priority: HIGHEST for action security_group_rules [ 786.105480] env[67094]: INFO networking_nsxv3.common.synchronization [req-832b20fd-8465-4791-a206-51d31d12f3ad req-e02bd795-89be-40f8-9d9d-89d06a92ebe1 tempest-SecurityGroupsTestJSON-1233321301 tempest-SecurityGroupsTestJSON-1233321301-project-member] Enqueued Resource ID: ae59884c-acbd-4c88-8cdb-fd8d14c95621 with Priority: HIGHEST for action security_group_members [ 786.105598] env[67094]: INFO networking_nsxv3.common.synchronization [req-832b20fd-8465-4791-a206-51d31d12f3ad req-e02bd795-89be-40f8-9d9d-89d06a92ebe1 tempest-SecurityGroupsTestJSON-1233321301 tempest-SecurityGroupsTestJSON-1233321301-project-member] Enqueued Resource ID: f7861002-4b91-437c-8519-9140d1a3bd82 with Priority: HIGHEST for action security_group_rules [ 786.105733] env[67094]: INFO networking_nsxv3.common.synchronization [req-832b20fd-8465-4791-a206-51d31d12f3ad req-e02bd795-89be-40f8-9d9d-89d06a92ebe1 tempest-SecurityGroupsTestJSON-1233321301 tempest-SecurityGroupsTestJSON-1233321301-project-member] Enqueued Resource ID: f7861002-4b91-437c-8519-9140d1a3bd82 with Priority: HIGHEST for action security_group_members [ 786.105879] env[67094]: INFO networking_nsxv3.common.synchronization [req-832b20fd-8465-4791-a206-51d31d12f3ad req-e02bd795-89be-40f8-9d9d-89d06a92ebe1 tempest-SecurityGroupsTestJSON-1233321301 tempest-SecurityGroupsTestJSON-1233321301-project-member] Enqueued Resource ID: dbaea447-eb60-4d7b-b784-b8cea012726a with Priority: HIGHEST for action port [ 786.106422] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 763488f4-7445-4094-9732-5af84c8ba064 with Priority: HIGHEST for action security_group_rules [ 786.106557] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae59884c-acbd-4c88-8cdb-fd8d14c95621 with Priority: HIGHEST for action security_group_rules [ 786.106652] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7861002-4b91-437c-8519-9140d1a3bd82 with Priority: HIGHEST for action security_group_members [ 786.106745] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbaea447-eb60-4d7b-b784-b8cea012726a with Priority: HIGHEST for action port [ 786.106834] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7861002-4b91-437c-8519-9140d1a3bd82 with Priority: HIGHEST for action security_group_rules [ 786.106924] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 763488f4-7445-4094-9732-5af84c8ba064 with Priority: HIGHEST for action security_group_members [ 786.107018] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae59884c-acbd-4c88-8cdb-fd8d14c95621 with Priority: HIGHEST for action security_group_members [ 786.107292] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-763488f4-7445-4094-9732-5af84c8ba064 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.107390] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-763488f4-7445-4094-9732-5af84c8ba064" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.107574] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ae59884c-acbd-4c88-8cdb-fd8d14c95621 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.107674] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ae59884c-acbd-4c88-8cdb-fd8d14c95621" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.107738] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ae59884c-acbd-4c88-8cdb-fd8d14c95621" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.108015] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ae59884c-acbd-4c88-8cdb-fd8d14c95621" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.108100] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ae59884c-acbd-4c88-8cdb-fd8d14c95621',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.109276] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7861002-4b91-437c-8519-9140d1a3bd82 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.109380] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.109528] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-dbaea447-eb60-4d7b-b784-b8cea012726a taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.109648] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dbaea447-eb60-4d7b-b784-b8cea012726a" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.109746] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dbaea447-eb60-4d7b-b784-b8cea012726a" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.109931] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dbaea447-eb60-4d7b-b784-b8cea012726a" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.109931] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dbaea447-eb60-4d7b-b784-b8cea012726a',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.110826] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f7861002-4b91-437c-8519-9140d1a3bd82 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.111041] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.111223] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-763488f4-7445-4094-9732-5af84c8ba064 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.111347] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-763488f4-7445-4094-9732-5af84c8ba064" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.111681] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae59884c-acbd-4c88-8cdb-fd8d14c95621 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.111755] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae59884c-acbd-4c88-8cdb-fd8d14c95621" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.170891] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71aa8195-5281-4a1c-b9a7-3d40e851f47e in Status: SUCCESS [ 786.170891] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71aa8195-5281-4a1c-b9a7-3d40e851f47e deletion is rescheduled due to dependency. [ 786.170891] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.170891] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f7861002-4b91-437c-8519-9140d1a3bd82',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.170891] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('763488f4-7445-4094-9732-5af84c8ba064',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.248624] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c49f7fe8-62a6-4df5-90fb-465116c226a3 in Status: SUCCESS [ 786.249342] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c49f7fe8-62a6-4df5-90fb-465116c226a3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.457986] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a685dbf9-8823-4364-9677-e8aff5bd2a59: rpc.has_security_group_logging(os_id): False [ 786.479393] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.479393] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.479393] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.479587] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.479587] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.479785] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.480011] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.480147] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.480466] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.480594] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.481850] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.481850] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.481850] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.481850] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.481850] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.482116] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.482233] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.482367] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.482634] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.482776] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.482893] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a685dbf9-8823-4364-9677-e8aff5bd2a59 is going to be created. [ 786.530421] env[67094]: INFO networking_nsxv3.common.synchronization [req-0cd71617-2085-4091-8a06-0e87fe32bf38 req-97bea9a5-80af-473d-b483-50266cfbee40 tempest-ServersTestJSON-1070791530 tempest-ServersTestJSON-1070791530-project-member] Enqueued Resource ID: c0881101-1be1-4dbf-ac18-2d54a689202c with Priority: HIGHEST for action security_group_members [ 786.531195] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0881101-1be1-4dbf-ac18-2d54a689202c with Priority: HIGHEST for action security_group_members [ 786.531605] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0881101-1be1-4dbf-ac18-2d54a689202c taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.531728] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.531793] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.532014] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.532212] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.532309] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.532360] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.532556] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.532721] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.532817] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.556217] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.556417] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.556462] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.556679] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.556857] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.558185] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ae59884c-acbd-4c88-8cdb-fd8d14c95621',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.559317] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.573812] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a685dbf9-8823-4364-9677-e8aff5bd2a59 in Status: IN_PROGRESS for 2s [ 786.612843] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dbaea447-eb60-4d7b-b784-b8cea012726a with status ACTIVE [ 786.613601] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.613793] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.613894] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.614224] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.614519] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.614604] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.614717] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.614863] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.615124] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.615225] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.615469] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.615585] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.615649] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.615858] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.616183] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.616463] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dbaea447-eb60-4d7b-b784-b8cea012726a is going to be updated. [ 786.619363] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae59884c-acbd-4c88-8cdb-fd8d14c95621 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.619363] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae59884c-acbd-4c88-8cdb-fd8d14c95621" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.664712] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.664712] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.664712] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.664712] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.664712] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.664712] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dbaea447-eb60-4d7b-b784-b8cea012726a" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.674123] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f7861002-4b91-437c-8519-9140d1a3bd82',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.674123] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('763488f4-7445-4094-9732-5af84c8ba064',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 786.939787] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock network-91 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.939930] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "network-91" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.940084] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "network-91" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.940385] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "network-91" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.940792] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.941025] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.941107] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.941374] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.941555] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.941795] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 786.941925] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 786.942042] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 786.942139] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 786.942249] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 786.942353] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 786.944974] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 786.973175] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 786.973175] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 786.973175] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 786.973175] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "network-91" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 786.973175] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock port-2aa91285-6474-4ead-af08-f3b18a1cd190 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 786.973175] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "port-2aa91285-6474-4ead-af08-f3b18a1cd190" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 786.973175] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "port-2aa91285-6474-4ead-af08-f3b18a1cd190" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 786.973175] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "port-2aa91285-6474-4ead-af08-f3b18a1cd190" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 786.973175] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2aa91285-6474-4ead-af08-f3b18a1cd190',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.035437] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.061405] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ae59884c-acbd-4c88-8cdb-fd8d14c95621',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.063335] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 787.063335] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 787.178762] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.179029] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.179073] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.179328] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.179417] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.179516] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7861002-4b91-437c-8519-9140d1a3bd82 is going to be updated. [ 787.180914] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.181054] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.181126] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.181326] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.181406] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.181495] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 763488f4-7445-4094-9732-5af84c8ba064 is going to be updated. [ 787.220066] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.220066] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.220066] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.220066] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.220066] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.222576] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.222576] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.222770] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.222911] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.223529] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.235352] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 763488f4-7445-4094-9732-5af84c8ba064 in Status: IN_PROGRESS for 2s [ 787.237218] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7861002-4b91-437c-8519-9140d1a3bd82 in Status: IN_PROGRESS for 2s [ 787.476462] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.476821] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.477195] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.477698] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.477982] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.478260] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Segment Port 2aa91285-6474-4ead-af08-f3b18a1cd190 not found, creating... [ 787.478769] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.479094] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.479295] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.479654] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.479851] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.480325] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.480615] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.480812] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.481205] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.481465] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.481730] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Resource: SegmentPort with ID: 2aa91285-6474-4ead-af08-f3b18a1cd190 is going to be created. [ 787.505889] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.506176] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.506336] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.506530] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.507019] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.507269] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "port-2aa91285-6474-4ead-af08-f3b18a1cd190" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.538071] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 787.565849] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.566028] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.566139] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.566295] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.566430] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.566523] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae59884c-acbd-4c88-8cdb-fd8d14c95621 is going to be created. [ 787.611784] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 787.611990] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 787.612091] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 787.612243] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 787.612399] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 787.626730] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae59884c-acbd-4c88-8cdb-fd8d14c95621 in Status: UNINITIALIZED for 2s [ 788.011480] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882c69d3-9554-45c6-97a1-55fb0f065040 in Status: SUCCESS [ 788.011844] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.011905] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.012117] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.012317] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.012439] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.012504] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.012665] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.012747] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.012832] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.012922] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('882c69d3-9554-45c6-97a1-55fb0f065040',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.043036] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.043112] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.043150] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.043353] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.043443] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.043538] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0881101-1be1-4dbf-ac18-2d54a689202c is going to be updated. [ 788.076255] env[67094]: INFO networking_nsxv3.common.synchronization [req-88b6b4c4-1025-4c21-8269-de09e9090212 req-5d01a4b2-ed60-4ff2-be3b-0f61500a4a91 tempest-SecurityGroupRulesTestJSON-2088080837 tempest-SecurityGroupRulesTestJSON-2088080837-project-member] Enqueued Resource ID: f2fdf7ee-2535-43c8-9397-6fe3df1d52d2 with Priority: HIGHEST for action security_group_rules [ 788.076255] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f2fdf7ee-2535-43c8-9397-6fe3df1d52d2 with Priority: HIGHEST for action security_group_rules [ 788.078467] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.078583] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.078700] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.078960] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.080012] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.080610] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f2fdf7ee-2535-43c8-9397-6fe3df1d52d2 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.080756] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f2fdf7ee-2535-43c8-9397-6fe3df1d52d2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.080828] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f2fdf7ee-2535-43c8-9397-6fe3df1d52d2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.081065] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f2fdf7ee-2535-43c8-9397-6fe3df1d52d2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.081225] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f2fdf7ee-2535-43c8-9397-6fe3df1d52d2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.094254] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0881101-1be1-4dbf-ac18-2d54a689202c in Status: IN_PROGRESS for 2s [ 788.102876] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.103069] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.103173] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.103460] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.126371] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 788.127241] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.128226] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 788.156673] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.156867] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.156867] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.157104] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.164082] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.164704] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:1. [ 788.165077] env[67094]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:{'dbaea447-eb60-4d7b-b784-b8cea012726a'} {{(pid=67094) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 788.165183] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 788.217116] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.217386] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.217472] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.217672] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.219912] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.219912] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 788.255203] env[67094]: INFO networking_nsxv3.common.synchronization [req-0cd71617-2085-4091-8a06-0e87fe32bf38 req-fe77f26a-4708-40ef-9740-9d351c69e1b3 service nova] Enqueued Resource ID: c0881101-1be1-4dbf-ac18-2d54a689202c with Priority: HIGHEST for action security_group_rules [ 788.255458] env[67094]: INFO networking_nsxv3.common.synchronization [req-0cd71617-2085-4091-8a06-0e87fe32bf38 req-fe77f26a-4708-40ef-9740-9d351c69e1b3 service nova] Enqueued Resource ID: c0881101-1be1-4dbf-ac18-2d54a689202c with Priority: HIGHEST for action security_group_members [ 788.255598] env[67094]: INFO networking_nsxv3.common.synchronization [req-0cd71617-2085-4091-8a06-0e87fe32bf38 req-fe77f26a-4708-40ef-9740-9d351c69e1b3 service nova] Enqueued Resource ID: 2aa91285-6474-4ead-af08-f3b18a1cd190 with Priority: HIGHEST for action port [ 788.257711] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0881101-1be1-4dbf-ac18-2d54a689202c with Priority: HIGHEST for action security_group_rules [ 788.257868] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0881101-1be1-4dbf-ac18-2d54a689202c with Priority: HIGHEST for action security_group_members [ 788.258161] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2aa91285-6474-4ead-af08-f3b18a1cd190 with Priority: HIGHEST for action port [ 788.258356] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0881101-1be1-4dbf-ac18-2d54a689202c taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.258484] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.258552] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.258753] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.258850] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.259819] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0881101-1be1-4dbf-ac18-2d54a689202c taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.259930] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.260442] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-2aa91285-6474-4ead-af08-f3b18a1cd190 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.260560] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2aa91285-6474-4ead-af08-f3b18a1cd190" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.260607] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2aa91285-6474-4ead-af08-f3b18a1cd190" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.260814] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2aa91285-6474-4ead-af08-f3b18a1cd190" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.260921] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2aa91285-6474-4ead-af08-f3b18a1cd190',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.409475] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.409704] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.409797] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.410053] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.410345] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.410671] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 788.492206] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.492420] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.492420] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.492666] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.492939] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.493272] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:35. [ 788.493367] env[67094]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'84918628-8f8e-4d25-9c0f-17cccb58ebfa', 'd2b2ce4e-7111-4ad3-93ce-373e771f2b15', '0ee9080c-8cce-48e3-86d7-285fa4431dd0', '23175cfa-70d8-4e87-b926-37d28add1977', '6b8aa78a-ad3e-4d9d-94d1-2156bff23176', '9f15f829-bf18-4bc7-bdf2-32c359ef7028', '00b541f3-9964-40ec-91e3-e2aa8166f007', '90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2', '79476966-6948-4fb4-811c-c9f8cee63da2', 'f7861002-4b91-437c-8519-9140d1a3bd82', 'a5894e01-0dd0-4818-929b-f9f643fa6db0', '8e29f908-2bce-40a4-9ad1-3ef30230e8e5', '018c19d8-0b0e-41bd-8f01-0c9c58710c57', '6427f088-550f-4c69-a5dd-5f9c7d4aadcf', 'f25d6704-85d6-488c-940d-05693a505db9', 'a685dbf9-8823-4364-9677-e8aff5bd2a59', 'c49f7fe8-62a6-4df5-90fb-465116c226a3', '71aa8195-5281-4a1c-b9a7-3d40e851f47e', 'eb77eddf-2e1d-485c-bfe8-67d4c174dc73', 'f71d6693-6145-4241-b055-f03e34f73c7f', '34103f55-eb7e-4602-9672-09596df7eaa4', '00f05527-967f-4b60-a2ba-dd3e2d9bad21', '62f0dd40-a793-48dd-b62a-abaa0eeebd45', 'fbf0de02-2c4b-4156-ae88-4a3e624f550d', '4e31526a-4068-4c26-bce5-72c9c1c3964e', '0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6', 'cb367675-42aa-4b50-8812-8a73fdef747d', '0c6a3072-604c-444a-b4d4-9ed06e060bef', '0d0028b4-3629-4ade-8832-b0fbfb48d140', '75d792df-97d6-4e1a-bf50-631a4a868869', 'c0881101-1be1-4dbf-ac18-2d54a689202c', '52851555-797a-47ba-b408-d4557f3f4ec2', '0f2ac94a-4beb-4e79-8490-47989224cf9f', '0e314269-1025-4c1f-b42e-8acab2134cbb', '60943622-73b5-4dda-ad21-63bf08db617e'} {{(pid=67094) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 788.493475] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 788.515479] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-882c69d3-9554-45c6-97a1-55fb0f065040 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.516119] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.516119] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.516292] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.516604] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.516780] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.517502] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.517502] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.517502] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.517502] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.517775] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-882c69d3-9554-45c6-97a1-55fb0f065040 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.517986] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.518111] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.518565] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.518662] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.518756] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.518857] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.519131] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.519274] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.519416] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.519558] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('882c69d3-9554-45c6-97a1-55fb0f065040',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 788.521526] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.521693] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.521767] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.521962] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.522126] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.522289] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 788.522434] env[67094]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=67094) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 788.522553] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 788.592409] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a685dbf9-8823-4364-9677-e8aff5bd2a59 in Status: SUCCESS [ 788.592492] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.604065] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.604554] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.604669] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.605385] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.605385] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.605385] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f2fdf7ee-2535-43c8-9397-6fe3df1d52d2 already deleted. [ 788.605385] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f2fdf7ee-2535-43c8-9397-6fe3df1d52d2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.617462] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.617462] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.617462] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.617820] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.618729] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.619053] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 788.619209] env[67094]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=67094) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 788.619343] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 788.619435] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 1/1 resources of Type:Ports [ 788.619704] env[67094]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: dbaea447-eb60-4d7b-b784-b8cea012726a with Priority: HIGH for action port [ 788.619704] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 19/35 resources of Type:Security Group Rules [ 788.619816] env[67094]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa with Priority: HIGH for action security_group_rules [ 788.619887] env[67094]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: d2b2ce4e-7111-4ad3-93ce-373e771f2b15 with Priority: HIGH for action security_group_rules [ 788.619978] env[67094]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0ee9080c-8cce-48e3-86d7-285fa4431dd0 with Priority: HIGH for action security_group_rules [ 788.620082] env[67094]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 23175cfa-70d8-4e87-b926-37d28add1977 with Priority: HIGH for action security_group_rules [ 788.620170] env[67094]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6b8aa78a-ad3e-4d9d-94d1-2156bff23176 with Priority: HIGH for action security_group_rules [ 788.620261] env[67094]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 with Priority: HIGH for action security_group_rules [ 788.620362] env[67094]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 00b541f3-9964-40ec-91e3-e2aa8166f007 with Priority: HIGH for action security_group_rules [ 788.620444] env[67094]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 with Priority: HIGH for action security_group_rules [ 788.620528] env[67094]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 79476966-6948-4fb4-811c-c9f8cee63da2 with Priority: HIGH for action security_group_rules [ 788.620726] env[67094]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f7861002-4b91-437c-8519-9140d1a3bd82 with Priority: HIGH for action security_group_rules [ 788.620841] env[67094]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a5894e01-0dd0-4818-929b-f9f643fa6db0 with Priority: HIGH for action security_group_rules [ 788.620927] env[67094]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8e29f908-2bce-40a4-9ad1-3ef30230e8e5 with Priority: HIGH for action security_group_rules [ 788.621035] env[67094]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 with Priority: HIGH for action security_group_rules [ 788.621133] env[67094]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6427f088-550f-4c69-a5dd-5f9c7d4aadcf with Priority: HIGH for action security_group_rules [ 788.621220] env[67094]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f25d6704-85d6-488c-940d-05693a505db9 with Priority: HIGH for action security_group_rules [ 788.621300] env[67094]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a685dbf9-8823-4364-9677-e8aff5bd2a59 with Priority: HIGH for action security_group_rules [ 788.621384] env[67094]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c49f7fe8-62a6-4df5-90fb-465116c226a3 with Priority: HIGH for action security_group_rules [ 788.621480] env[67094]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 71aa8195-5281-4a1c-b9a7-3d40e851f47e with Priority: HIGH for action security_group_rules [ 788.621566] env[67094]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: eb77eddf-2e1d-485c-bfe8-67d4c174dc73 with Priority: HIGH for action security_group_rules [ 788.621690] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.763792] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0881101-1be1-4dbf-ac18-2d54a689202c taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.763961] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.764205] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 2aa91285-6474-4ead-af08-f3b18a1cd190 with status ACTIVE [ 788.764400] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.764616] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.764616] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.764853] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.764974] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.765315] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.765315] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.765438] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.765737] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.765737] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.765839] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.765934] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.767043] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.767043] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.767043] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.767043] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 2aa91285-6474-4ead-af08-f3b18a1cd190 is going to be updated. [ 788.794892] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 788.795249] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 788.795249] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 788.795351] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 788.795431] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 788.795678] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2aa91285-6474-4ead-af08-f3b18a1cd190" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.025451] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 882c69d3-9554-45c6-97a1-55fb0f065040: rpc.has_security_group_logging(os_id): False [ 789.060180] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.060425] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.061022] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.061022] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.061022] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.061232] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.061385] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.061481] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.061701] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.061816] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.062219] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.062810] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.062810] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.062915] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.063038] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.063357] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.063536] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.063661] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.063892] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.064156] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.064213] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 882c69d3-9554-45c6-97a1-55fb0f065040 is going to be created. [ 789.145363] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.145519] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.145577] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.145786] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.147094] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.158369] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 882c69d3-9554-45c6-97a1-55fb0f065040 in Status: IN_PROGRESS for 2s [ 789.188336] env[67094]: INFO networking_nsxv3.common.synchronization [req-87a69e70-a5cd-4b89-8f6d-4ef909afdec8 req-c996e038-e529-47ac-b505-786b1b6d844e tempest-ServersAdminTestJSON-236082081 tempest-ServersAdminTestJSON-236082081-project-member] Enqueued Resource ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f with Priority: HIGHEST for action security_group_members [ 789.189400] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f with Priority: HIGHEST for action security_group_members [ 789.189578] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: dbaea447-eb60-4d7b-b784-b8cea012726a with Priority: HIGH for action port [ 789.190067] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d2b2ce4e-7111-4ad3-93ce-373e771f2b15 with Priority: HIGH for action security_group_rules [ 789.190067] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 with Priority: HIGH for action security_group_rules [ 789.190067] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6427f088-550f-4c69-a5dd-5f9c7d4aadcf with Priority: HIGH for action security_group_rules [ 789.191337] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb77eddf-2e1d-485c-bfe8-67d4c174dc73 with Priority: HIGH for action security_group_rules [ 789.191337] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71aa8195-5281-4a1c-b9a7-3d40e851f47e with Priority: HIGH for action security_group_rules [ 789.191337] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c49f7fe8-62a6-4df5-90fb-465116c226a3 with Priority: HIGH for action security_group_rules [ 789.191337] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a685dbf9-8823-4364-9677-e8aff5bd2a59 with Priority: HIGH for action security_group_rules [ 789.191337] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 with Priority: HIGH for action security_group_rules [ 789.191337] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f25d6704-85d6-488c-940d-05693a505db9 with Priority: HIGH for action security_group_rules [ 789.191337] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e29f908-2bce-40a4-9ad1-3ef30230e8e5 with Priority: HIGH for action security_group_rules [ 789.191337] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a5894e01-0dd0-4818-929b-f9f643fa6db0 with Priority: HIGH for action security_group_rules [ 789.191713] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7861002-4b91-437c-8519-9140d1a3bd82 with Priority: HIGH for action security_group_rules [ 789.191713] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79476966-6948-4fb4-811c-c9f8cee63da2 with Priority: HIGH for action security_group_rules [ 789.191713] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 with Priority: HIGH for action security_group_rules [ 789.191713] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b8aa78a-ad3e-4d9d-94d1-2156bff23176 with Priority: HIGH for action security_group_rules [ 789.191821] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00b541f3-9964-40ec-91e3-e2aa8166f007 with Priority: HIGH for action security_group_rules [ 789.191955] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 23175cfa-70d8-4e87-b926-37d28add1977 with Priority: HIGH for action security_group_rules [ 789.192032] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa with Priority: HIGH for action security_group_rules [ 789.192287] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ee9080c-8cce-48e3-86d7-285fa4431dd0 with Priority: HIGH for action security_group_rules [ 789.192738] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f2ac94a-4beb-4e79-8490-47989224cf9f taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.192995] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.192995] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.193416] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.193416] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.193635] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.193635] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.193854] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.193977] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.194144] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f2ac94a-4beb-4e79-8490-47989224cf9f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.195132] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-dbaea447-eb60-4d7b-b784-b8cea012726a taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.195632] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-dbaea447-eb60-4d7b-b784-b8cea012726a" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.195632] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-dbaea447-eb60-4d7b-b784-b8cea012726a" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.195632] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-dbaea447-eb60-4d7b-b784-b8cea012726a" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.195632] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('dbaea447-eb60-4d7b-b784-b8cea012726a',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.197105] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-d2b2ce4e-7111-4ad3-93ce-373e771f2b15 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.197232] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-d2b2ce4e-7111-4ad3-93ce-373e771f2b15" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.197232] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-d2b2ce4e-7111-4ad3-93ce-373e771f2b15" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.197461] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-d2b2ce4e-7111-4ad3-93ce-373e771f2b15" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.197550] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('d2b2ce4e-7111-4ad3-93ce-373e771f2b15',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.198399] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9f15f829-bf18-4bc7-bdf2-32c359ef7028 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.198521] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.200296] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.200296] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.200296] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9f15f829-bf18-4bc7-bdf2-32c359ef7028',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.202855] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6427f088-550f-4c69-a5dd-5f9c7d4aadcf taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.202855] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6427f088-550f-4c69-a5dd-5f9c7d4aadcf" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.202855] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6427f088-550f-4c69-a5dd-5f9c7d4aadcf" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.202855] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6427f088-550f-4c69-a5dd-5f9c7d4aadcf" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.203442] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6427f088-550f-4c69-a5dd-5f9c7d4aadcf',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.204868] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-eb77eddf-2e1d-485c-bfe8-67d4c174dc73 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.204868] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-eb77eddf-2e1d-485c-bfe8-67d4c174dc73" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.204868] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-eb77eddf-2e1d-485c-bfe8-67d4c174dc73" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.204868] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-eb77eddf-2e1d-485c-bfe8-67d4c174dc73" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.204868] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('eb77eddf-2e1d-485c-bfe8-67d4c174dc73',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.206027] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-71aa8195-5281-4a1c-b9a7-3d40e851f47e taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.206027] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.206027] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.206027] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.208168] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('71aa8195-5281-4a1c-b9a7-3d40e851f47e',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.208168] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c49f7fe8-62a6-4df5-90fb-465116c226a3 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.208168] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c49f7fe8-62a6-4df5-90fb-465116c226a3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.208168] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c49f7fe8-62a6-4df5-90fb-465116c226a3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.208168] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c49f7fe8-62a6-4df5-90fb-465116c226a3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.208168] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c49f7fe8-62a6-4df5-90fb-465116c226a3',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.209060] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a685dbf9-8823-4364-9677-e8aff5bd2a59 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.209060] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.210925] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.211557] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.211557] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a685dbf9-8823-4364-9677-e8aff5bd2a59',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.212315] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-018c19d8-0b0e-41bd-8f01-0c9c58710c57 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.212521] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.213133] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.213133] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.213250] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('018c19d8-0b0e-41bd-8f01-0c9c58710c57',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.214553] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f25d6704-85d6-488c-940d-05693a505db9 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.216485] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f25d6704-85d6-488c-940d-05693a505db9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.216485] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f25d6704-85d6-488c-940d-05693a505db9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.216485] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f25d6704-85d6-488c-940d-05693a505db9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.216485] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f25d6704-85d6-488c-940d-05693a505db9',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.216485] env[67094]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20 [ 789.217399] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8e29f908-2bce-40a4-9ad1-3ef30230e8e5 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.217399] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8e29f908-2bce-40a4-9ad1-3ef30230e8e5" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.217399] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8e29f908-2bce-40a4-9ad1-3ef30230e8e5" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.217399] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8e29f908-2bce-40a4-9ad1-3ef30230e8e5" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.217399] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8e29f908-2bce-40a4-9ad1-3ef30230e8e5',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.219308] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a5894e01-0dd0-4818-929b-f9f643fa6db0 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.219308] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a5894e01-0dd0-4818-929b-f9f643fa6db0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.219308] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a5894e01-0dd0-4818-929b-f9f643fa6db0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.219308] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a5894e01-0dd0-4818-929b-f9f643fa6db0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.219308] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a5894e01-0dd0-4818-929b-f9f643fa6db0',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.220384] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f7861002-4b91-437c-8519-9140d1a3bd82 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.220494] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.220743] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-79476966-6948-4fb4-811c-c9f8cee63da2 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.220850] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.220924] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.221369] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.221487] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('79476966-6948-4fb4-811c-c9f8cee63da2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.222827] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.222827] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.222954] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.223082] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.223174] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.224167] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b8aa78a-ad3e-4d9d-94d1-2156bff23176 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.224280] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b8aa78a-ad3e-4d9d-94d1-2156bff23176" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.224857] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b8aa78a-ad3e-4d9d-94d1-2156bff23176" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.224857] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b8aa78a-ad3e-4d9d-94d1-2156bff23176" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.224857] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b8aa78a-ad3e-4d9d-94d1-2156bff23176',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.225668] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00b541f3-9964-40ec-91e3-e2aa8166f007 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.225778] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00b541f3-9964-40ec-91e3-e2aa8166f007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.225853] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00b541f3-9964-40ec-91e3-e2aa8166f007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.226363] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00b541f3-9964-40ec-91e3-e2aa8166f007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.226363] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00b541f3-9964-40ec-91e3-e2aa8166f007',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.227401] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-23175cfa-70d8-4e87-b926-37d28add1977 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.227401] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-23175cfa-70d8-4e87-b926-37d28add1977" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.227537] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-23175cfa-70d8-4e87-b926-37d28add1977" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.227629] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-23175cfa-70d8-4e87-b926-37d28add1977" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.227715] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('23175cfa-70d8-4e87-b926-37d28add1977',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.228847] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-84918628-8f8e-4d25-9c0f-17cccb58ebfa taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.228992] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.229100] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.229289] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.229372] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('84918628-8f8e-4d25-9c0f-17cccb58ebfa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.230871] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ee9080c-8cce-48e3-86d7-285fa4431dd0 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.230995] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.231073] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.231302] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.231420] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ee9080c-8cce-48e3-86d7-285fa4431dd0',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.234741] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0f2ac94a-4beb-4e79-8490-47989224cf9f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.278100] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7861002-4b91-437c-8519-9140d1a3bd82 in Status: SUCCESS [ 789.278524] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.280168] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.280732] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.281032] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.281200] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.281310] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.281523] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.281657] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.284971] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.284971] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f7861002-4b91-437c-8519-9140d1a3bd82',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.284971] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.284971] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.284971] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.284971] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.287562] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 763488f4-7445-4094-9732-5af84c8ba064 in Status: SUCCESS [ 789.287777] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-763488f4-7445-4094-9732-5af84c8ba064" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.288409] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.288643] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.288855] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.289023] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.289087] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.289298] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.289433] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.289583] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7861002-4b91-437c-8519-9140d1a3bd82',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.290025] env[67094]: WARNING oslo_messaging._drivers.amqpdriver [-] Number of call queues is 21, greater than warning threshold: 20. There could be a leak. Increasing threshold to: 40 [ 789.291096] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-763488f4-7445-4094-9732-5af84c8ba064" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.291305] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-763488f4-7445-4094-9732-5af84c8ba064" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.291518] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.291646] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.291742] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.291951] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.292055] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.292183] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-763488f4-7445-4094-9732-5af84c8ba064" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.292394] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('763488f4-7445-4094-9732-5af84c8ba064',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.294507] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-763488f4-7445-4094-9732-5af84c8ba064" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.294694] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-763488f4-7445-4094-9732-5af84c8ba064" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.294877] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.294992] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.295064] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.295241] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.295328] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.295421] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('763488f4-7445-4094-9732-5af84c8ba064',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.484864] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.485050] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: d2b2ce4e-7111-4ad3-93ce-373e771f2b15 is going to be deleted. [ 789.544166] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.544543] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.545256] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.545256] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.545256] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.545256] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-d2b2ce4e-7111-4ad3-93ce-373e771f2b15" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.639203] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae59884c-acbd-4c88-8cdb-fd8d14c95621 in Status: SUCCESS [ 789.639203] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae59884c-acbd-4c88-8cdb-fd8d14c95621" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.639203] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae59884c-acbd-4c88-8cdb-fd8d14c95621" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.639203] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae59884c-acbd-4c88-8cdb-fd8d14c95621" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.639471] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.639535] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.640344] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.640344] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.640344] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.640344] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae59884c-acbd-4c88-8cdb-fd8d14c95621',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.702909] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock network-107 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.705955] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "network-107" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.705955] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "network-107" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.705955] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "network-107" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.705955] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.705955] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.705955] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.705955] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.705955] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.706491] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 789.706661] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 789.706780] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 789.706890] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 789.707018] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 789.707126] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 789.707256] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 789.727230] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 789.727395] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 789.727636] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 789.727824] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "network-107" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.728277] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock port-8203f522-bc6e-4e14-b117-5565f4e3f7fa taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.728461] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "port-8203f522-bc6e-4e14-b117-5565f4e3f7fa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.728659] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "port-8203f522-bc6e-4e14-b117-5565f4e3f7fa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.728878] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "port-8203f522-bc6e-4e14-b117-5565f4e3f7fa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.729027] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8203f522-bc6e-4e14-b117-5565f4e3f7fa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.741090] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port dbaea447-eb60-4d7b-b784-b8cea012726a with status ACTIVE [ 789.741357] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.741962] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.741962] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.741962] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.741962] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.742195] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.742195] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.742282] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.742371] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.742443] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.742620] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.742709] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.742771] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.742909] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.742985] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.743108] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: dbaea447-eb60-4d7b-b784-b8cea012726a is going to be updated. [ 789.745154] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0f2ac94a-4beb-4e79-8490-47989224cf9f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.768740] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.768888] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.768977] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.769295] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.769415] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.769580] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-dbaea447-eb60-4d7b-b784-b8cea012726a" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.776524] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-018c19d8-0b0e-41bd-8f01-0c9c58710c57 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.776648] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.776688] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.776879] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.777058] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.777161] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.777227] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.777376] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.777603] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.777689] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.777779] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('018c19d8-0b0e-41bd-8f01-0c9c58710c57',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.782788] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ee9080c-8cce-48e3-86d7-285fa4431dd0 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.782788] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.782788] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.782788] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.782788] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.782788] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.782788] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.783330] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.783330] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.783330] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.783330] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0ee9080c-8cce-48e3-86d7-285fa4431dd0',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.786433] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-a685dbf9-8823-4364-9677-e8aff5bd2a59 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.786433] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.786433] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.786433] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.786433] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.786433] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.786433] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.786945] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.786945] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.786945] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.786945] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a685dbf9-8823-4364-9677-e8aff5bd2a59',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.796543] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b8aa78a-ad3e-4d9d-94d1-2156bff23176 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.796791] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b8aa78a-ad3e-4d9d-94d1-2156bff23176" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.796888] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b8aa78a-ad3e-4d9d-94d1-2156bff23176" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.798744] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b8aa78a-ad3e-4d9d-94d1-2156bff23176" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.798744] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.798744] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.798744] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.798744] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.798744] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.798744] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b8aa78a-ad3e-4d9d-94d1-2156bff23176" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.798744] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6b8aa78a-ad3e-4d9d-94d1-2156bff23176',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.800023] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb77eddf-2e1d-485c-bfe8-67d4c174dc73 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.800223] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb77eddf-2e1d-485c-bfe8-67d4c174dc73" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.800327] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb77eddf-2e1d-485c-bfe8-67d4c174dc73" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.800553] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb77eddf-2e1d-485c-bfe8-67d4c174dc73" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.800786] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.800932] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.801068] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.801257] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.801396] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.801513] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb77eddf-2e1d-485c-bfe8-67d4c174dc73" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.801789] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('eb77eddf-2e1d-485c-bfe8-67d4c174dc73',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.804826] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-c49f7fe8-62a6-4df5-90fb-465116c226a3 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.805012] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c49f7fe8-62a6-4df5-90fb-465116c226a3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.805124] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c49f7fe8-62a6-4df5-90fb-465116c226a3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.806351] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c49f7fe8-62a6-4df5-90fb-465116c226a3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.806351] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.806351] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.806351] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.807027] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.807172] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.807320] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c49f7fe8-62a6-4df5-90fb-465116c226a3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.807457] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c49f7fe8-62a6-4df5-90fb-465116c226a3',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.814253] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-79476966-6948-4fb4-811c-c9f8cee63da2 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.815279] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.815279] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.815279] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.815279] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.815617] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.815617] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.815617] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.815877] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.815877] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.816022] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('79476966-6948-4fb4-811c-c9f8cee63da2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.821833] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-00b541f3-9964-40ec-91e3-e2aa8166f007 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.822051] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00b541f3-9964-40ec-91e3-e2aa8166f007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.822186] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00b541f3-9964-40ec-91e3-e2aa8166f007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.822519] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00b541f3-9964-40ec-91e3-e2aa8166f007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.822824] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.823055] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.823122] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.823351] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.823490] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.823788] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00b541f3-9964-40ec-91e3-e2aa8166f007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.823953] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('00b541f3-9964-40ec-91e3-e2aa8166f007',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.825413] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f7861002-4b91-437c-8519-9140d1a3bd82',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.827982] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7861002-4b91-437c-8519-9140d1a3bd82 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.828164] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.834955] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.835253] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.835324] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.835912] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.837573] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('eb77eddf-2e1d-485c-bfe8-67d4c174dc73',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.839745] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.839942] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.841725] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.841725] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.844108] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('763488f4-7445-4094-9732-5af84c8ba064',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.845464] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('763488f4-7445-4094-9732-5af84c8ba064',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.889263] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.889475] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.895639] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.895834] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.897545] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.897736] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.898958] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.899145] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.900997] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.901183] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa is going to be deleted. [ 789.902749] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.904700] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.910428] env[67094]: INFO networking_nsxv3.common.synchronization [req-7b6c58fd-ebb7-4c72-bf63-e9c9b3b5562a req-7417a23a-fbf9-49cd-95cc-ac2559eefafd tempest-SecurityGroupRulesNegativeTestJSON-997979899 tempest-SecurityGroupRulesNegativeTestJSON-997979899-project-member] Enqueued Resource ID: 912f26d1-3a28-4efe-a036-9d3538e2a931 with Priority: HIGHEST for action security_group_rules [ 789.911332] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 912f26d1-3a28-4efe-a036-9d3538e2a931 with Priority: HIGHEST for action security_group_rules [ 789.911677] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-912f26d1-3a28-4efe-a036-9d3538e2a931 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.911810] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-912f26d1-3a28-4efe-a036-9d3538e2a931" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.911941] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-912f26d1-3a28-4efe-a036-9d3538e2a931" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.912286] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-912f26d1-3a28-4efe-a036-9d3538e2a931" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.912286] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('912f26d1-3a28-4efe-a036-9d3538e2a931',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 789.922134] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.922134] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.922627] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 789.922762] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 789.955328] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.955544] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9f15f829-bf18-4bc7-bdf2-32c359ef7028 is going to be deleted. [ 789.956695] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.956942] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 789.996638] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 789.996638] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f25d6704-85d6-488c-940d-05693a505db9 is going to be deleted. [ 789.997544] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 789.997758] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.037958] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.038408] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.040152] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.040302] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2 is going to be deleted. [ 790.041259] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.041479] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.082906] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.083100] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 71aa8195-5281-4a1c-b9a7-3d40e851f47e is going to be deleted. [ 790.084087] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.084332] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.123621] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.124378] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.128739] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0881101-1be1-4dbf-ac18-2d54a689202c in Status: SUCCESS [ 790.129438] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.129779] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.130147] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.131144] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.131144] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.131144] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.131589] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.131863] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.132059] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.134968] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.134968] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.142821] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('ae59884c-acbd-4c88-8cdb-fd8d14c95621',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.157508] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.157708] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.160828] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.161020] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8e29f908-2bce-40a4-9ad1-3ef30230e8e5 is going to be deleted. [ 790.162537] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.162812] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.224759] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.224965] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a5894e01-0dd0-4818-929b-f9f643fa6db0 is going to be deleted. [ 790.226186] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.226422] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.231910] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.232199] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.232337] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.232619] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.232774] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.232929] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Segment Port 8203f522-bc6e-4e14-b117-5565f4e3f7fa not found, creating... [ 790.233238] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.233457] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.233645] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.233940] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.234136] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.234528] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.234737] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.235095] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.235217] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.235299] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.235448] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Resource: SegmentPort with ID: 8203f522-bc6e-4e14-b117-5565f4e3f7fa is going to be created. [ 790.248272] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.248469] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.248514] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.248699] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.248784] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.248884] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f is going to be updated. [ 790.280993] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('018c19d8-0b0e-41bd-8f01-0c9c58710c57',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.284596] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.284729] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6427f088-550f-4c69-a5dd-5f9c7d4aadcf is going to be deleted. [ 790.285619] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.285847] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.293664] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ee9080c-8cce-48e3-86d7-285fa4431dd0 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.293823] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.293899] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.294190] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.294309] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.294415] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.294480] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.294632] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.294720] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.294808] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.295130] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ee9080c-8cce-48e3-86d7-285fa4431dd0 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.295239] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.295302] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.295446] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.295588] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.295742] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.295742] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.295979] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.296127] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.296127] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.296234] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0ee9080c-8cce-48e3-86d7-285fa4431dd0',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.297257] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-a685dbf9-8823-4364-9677-e8aff5bd2a59 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.297392] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.297449] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.298082] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.298082] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.298082] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.298082] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.298082] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.299268] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.299268] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.299268] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-a685dbf9-8823-4364-9677-e8aff5bd2a59 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.299268] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.299268] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.299268] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.299268] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.299268] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.299268] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.299268] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.299268] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.299268] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.299268] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a685dbf9-8823-4364-9677-e8aff5bd2a59',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.307116] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.307340] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.307462] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.307710] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.307976] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.308283] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "port-8203f522-bc6e-4e14-b117-5565f4e3f7fa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.310391] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.310504] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.332460] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-79476966-6948-4fb4-811c-c9f8cee63da2 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.332460] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.332460] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.332460] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.332460] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.332460] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.332460] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.332460] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.332460] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.332460] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.332460] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-79476966-6948-4fb4-811c-c9f8cee63da2 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.332460] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.332460] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.332460] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.332460] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.332460] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.333081] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.333081] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.333081] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.333081] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.333081] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('79476966-6948-4fb4-811c-c9f8cee63da2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.333971] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f7861002-4b91-437c-8519-9140d1a3bd82',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.334978] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-c49f7fe8-62a6-4df5-90fb-465116c226a3 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.335339] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c49f7fe8-62a6-4df5-90fb-465116c226a3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.335503] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c49f7fe8-62a6-4df5-90fb-465116c226a3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.335782] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c49f7fe8-62a6-4df5-90fb-465116c226a3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.336200] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.336465] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.336732] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.337061] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.337282] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.337600] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c49f7fe8-62a6-4df5-90fb-465116c226a3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.337883] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-c49f7fe8-62a6-4df5-90fb-465116c226a3 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.338192] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c49f7fe8-62a6-4df5-90fb-465116c226a3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.338344] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c49f7fe8-62a6-4df5-90fb-465116c226a3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.338608] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c49f7fe8-62a6-4df5-90fb-465116c226a3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.338892] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.339159] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.339323] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.339560] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.339727] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.340829] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c49f7fe8-62a6-4df5-90fb-465116c226a3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.340829] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c49f7fe8-62a6-4df5-90fb-465116c226a3',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.342813] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('00b541f3-9964-40ec-91e3-e2aa8166f007',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.342813] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6b8aa78a-ad3e-4d9d-94d1-2156bff23176',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.349430] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for eb77eddf-2e1d-485c-bfe8-67d4c174dc73: rpc.has_security_group_logging(os_id): False [ 790.350704] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('763488f4-7445-4094-9732-5af84c8ba064',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.351635] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 763488f4-7445-4094-9732-5af84c8ba064: rpc.has_security_group_logging(os_id): False [ 790.403270] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.403270] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.403270] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.403270] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.403270] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.405517] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.405853] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 23175cfa-70d8-4e87-b926-37d28add1977 is going to be deleted. [ 790.407293] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.407795] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.408063] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.408305] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.408616] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.409017] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.409210] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.409417] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f25d6704-85d6-488c-940d-05693a505db9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.410406] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.410731] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.410940] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.411193] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9f15f829-bf18-4bc7-bdf2-32c359ef7028" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.411498] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.412302] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.412389] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.412512] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-90fd1e6c-2b2f-44d2-a9f2-44a7e9f8faa2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.412663] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.412822] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.412898] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.413029] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.445200] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.445408] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.445496] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.445785] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.445922] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.446260] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.446449] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.446449] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.446657] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.446735] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.446840] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 763488f4-7445-4094-9732-5af84c8ba064 is going to be created. [ 790.448949] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.449157] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.449394] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.449579] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.449759] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.449950] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a5894e01-0dd0-4818-929b-f9f643fa6db0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.451172] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.451459] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.451594] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.451845] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.453914] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f in Status: IN_PROGRESS for 2s [ 790.454441] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.455848] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.455848] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.456059] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.510110] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.510315] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.510422] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.510503] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.510691] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.510775] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.510871] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: eb77eddf-2e1d-485c-bfe8-67d4c174dc73 is going to be updated. [ 790.511963] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.512652] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.512816] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.512972] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8e29f908-2bce-40a4-9ad1-3ef30230e8e5" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.513181] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.513378] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.513505] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.513642] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 912f26d1-3a28-4efe-a036-9d3538e2a931 already deleted. [ 790.513806] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-912f26d1-3a28-4efe-a036-9d3538e2a931" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.574401] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.574651] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.574871] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.575168] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.575237] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.575352] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-23175cfa-70d8-4e87-b926-37d28add1977" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.584941] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.585165] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.585165] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.585434] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.585553] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.585681] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6427f088-550f-4c69-a5dd-5f9c7d4aadcf" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.622584] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.622802] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.622802] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.623199] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.623457] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.636445] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.647623] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 763488f4-7445-4094-9732-5af84c8ba064 in Status: IN_PROGRESS for 2s [ 790.647818] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('ae59884c-acbd-4c88-8cdb-fd8d14c95621',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 790.776028] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.776028] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.776028] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.776028] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.776028] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.783693] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 018c19d8-0b0e-41bd-8f01-0c9c58710c57: rpc.has_security_group_logging(os_id): False [ 790.801071] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0ee9080c-8cce-48e3-86d7-285fa4431dd0: rpc.has_security_group_logging(os_id): False [ 790.807105] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a685dbf9-8823-4364-9677-e8aff5bd2a59: rpc.has_security_group_logging(os_id): False [ 790.807342] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eb77eddf-2e1d-485c-bfe8-67d4c174dc73 in Status: IN_PROGRESS for 2s [ 790.835432] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 79476966-6948-4fb4-811c-c9f8cee63da2: rpc.has_security_group_logging(os_id): False [ 790.845662] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.845662] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.845662] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.845662] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.845662] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.845662] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7861002-4b91-437c-8519-9140d1a3bd82 is going to be updated. [ 790.845662] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 00b541f3-9964-40ec-91e3-e2aa8166f007: rpc.has_security_group_logging(os_id): False [ 790.848162] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c49f7fe8-62a6-4df5-90fb-465116c226a3: rpc.has_security_group_logging(os_id): False [ 790.849429] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6b8aa78a-ad3e-4d9d-94d1-2156bff23176: rpc.has_security_group_logging(os_id): False [ 790.856332] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.856332] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.856332] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.856332] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.856332] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.856332] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 763488f4-7445-4094-9732-5af84c8ba064 is going to be updated. [ 790.877239] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.877239] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.877239] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.877239] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.890949] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.890949] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.890949] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.890949] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.897825] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.897825] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.897825] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.897825] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.897825] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.897825] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.904499] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.904499] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.949778] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.950318] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.950495] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.950495] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.950779] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.950891] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.951178] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 is going to be updated. [ 790.953130] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.953350] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.955431] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.955604] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.955604] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.955804] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.956139] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.959399] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 790.959576] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 790.959663] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 790.959909] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 790.960047] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 790.983765] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 763488f4-7445-4094-9732-5af84c8ba064 in Status: IN_PROGRESS for 2s [ 790.984923] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7861002-4b91-437c-8519-9140d1a3bd82 in Status: IN_PROGRESS for 2s [ 791.002495] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.002822] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.002956] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.003039] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.003215] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.003571] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.003571] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.003711] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.003711] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.003810] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.003894] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.004262] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.004380] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.004437] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.004583] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.004662] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.004772] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c49f7fe8-62a6-4df5-90fb-465116c226a3 is going to be updated. [ 791.006523] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.006523] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.046665] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.047094] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.047094] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.047094] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.047335] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.047384] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.047752] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b8aa78a-ad3e-4d9d-94d1-2156bff23176 is going to be updated. [ 791.048841] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.049053] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.065342] env[67094]: INFO networking_nsxv3.common.synchronization [req-87a69e70-a5cd-4b89-8f6d-4ef909afdec8 req-9ea185d5-f69e-4215-b7f5-3a687712317d service nova] Enqueued Resource ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f with Priority: HIGHEST for action security_group_rules [ 791.065524] env[67094]: INFO networking_nsxv3.common.synchronization [req-87a69e70-a5cd-4b89-8f6d-4ef909afdec8 req-9ea185d5-f69e-4215-b7f5-3a687712317d service nova] Enqueued Resource ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f with Priority: HIGHEST for action security_group_members [ 791.065662] env[67094]: INFO networking_nsxv3.common.synchronization [req-87a69e70-a5cd-4b89-8f6d-4ef909afdec8 req-9ea185d5-f69e-4215-b7f5-3a687712317d service nova] Enqueued Resource ID: 8203f522-bc6e-4e14-b117-5565f4e3f7fa with Priority: HIGHEST for action port [ 791.066876] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f with Priority: HIGHEST for action security_group_rules [ 791.067069] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f with Priority: HIGHEST for action security_group_members [ 791.067189] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8203f522-bc6e-4e14-b117-5565f4e3f7fa with Priority: HIGHEST for action port [ 791.067600] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0f2ac94a-4beb-4e79-8490-47989224cf9f taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.069054] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.069152] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.069376] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.069492] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0f2ac94a-4beb-4e79-8490-47989224cf9f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.070533] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f2ac94a-4beb-4e79-8490-47989224cf9f taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.070673] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.070808] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-8203f522-bc6e-4e14-b117-5565f4e3f7fa taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.070913] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8203f522-bc6e-4e14-b117-5565f4e3f7fa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.071077] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8203f522-bc6e-4e14-b117-5565f4e3f7fa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.071355] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8203f522-bc6e-4e14-b117-5565f4e3f7fa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.071355] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8203f522-bc6e-4e14-b117-5565f4e3f7fa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.083611] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.083611] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.083611] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.083611] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.083611] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.083944] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.083987] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.084371] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.084371] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.084503] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.084558] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.084832] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.084937] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.086686] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.087078] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.087241] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.087395] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ee9080c-8cce-48e3-86d7-285fa4431dd0 is going to be updated. [ 791.089057] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.089259] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.091992] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.092117] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.135070] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.135583] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.135758] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.135891] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.136228] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.136401] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.136555] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00b541f3-9964-40ec-91e3-e2aa8166f007 is going to be updated. [ 791.139128] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.139434] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.141548] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.149816] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.149966] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.150061] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.150288] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.150378] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.150475] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae59884c-acbd-4c88-8cdb-fd8d14c95621 is going to be updated. [ 791.160517] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.160707] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.190537] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 882c69d3-9554-45c6-97a1-55fb0f065040 in Status: SUCCESS [ 791.192203] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.194712] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.198272] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.198391] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.198477] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.198739] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.198850] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.199189] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.199312] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.199376] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.199576] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.199662] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.199904] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.199990] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.200078] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.200687] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.200687] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.200687] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 79476966-6948-4fb4-811c-c9f8cee63da2 is going to be updated. [ 791.201941] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.202199] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.202426] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.203626] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.204242] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.265263] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.265263] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.292129] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.292218] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.296324] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 in Status: IN_PROGRESS for 2s [ 791.297765] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.298301] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.298390] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.298665] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.298878] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.301226] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.301561] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.301752] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.301893] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.302355] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.302592] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.302833] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.303085] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.303241] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.304242] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.304242] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.304242] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.304242] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.304242] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.304677] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.304891] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.305194] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a685dbf9-8823-4364-9677-e8aff5bd2a59 is going to be updated. [ 791.306636] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.308710] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.308710] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.309423] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.309713] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.311017] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.311990] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.312228] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.312402] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.335655] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae59884c-acbd-4c88-8cdb-fd8d14c95621 in Status: IN_PROGRESS for 2s [ 791.394633] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b8aa78a-ad3e-4d9d-94d1-2156bff23176 in Status: IN_PROGRESS for 2s [ 791.396121] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c49f7fe8-62a6-4df5-90fb-465116c226a3 in Status: IN_PROGRESS for 2s [ 791.401132] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.402276] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.402276] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.402276] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.402276] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.415133] env[67094]: INFO networking_nsxv3.common.synchronization [req-472463c7-cca5-418d-89c4-1cc0a8c3b4e3 req-e69d63e9-9baf-47e2-b0af-196aee2401c4 tempest-SecurityGroupRulesTestJSON-2088080837 tempest-SecurityGroupRulesTestJSON-2088080837-project-member] Enqueued Resource ID: 1bb9bd0b-73a9-4e91-b9f6-f782acce595d with Priority: HIGHEST for action security_group_rules [ 791.415896] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1bb9bd0b-73a9-4e91-b9f6-f782acce595d with Priority: HIGHEST for action security_group_rules [ 791.416498] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1bb9bd0b-73a9-4e91-b9f6-f782acce595d taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.417924] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1bb9bd0b-73a9-4e91-b9f6-f782acce595d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.417924] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1bb9bd0b-73a9-4e91-b9f6-f782acce595d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.417924] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1bb9bd0b-73a9-4e91-b9f6-f782acce595d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.417924] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1bb9bd0b-73a9-4e91-b9f6-f782acce595d',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.440020] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0ee9080c-8cce-48e3-86d7-285fa4431dd0 in Status: IN_PROGRESS for 2s [ 791.440419] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.440543] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.440607] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.440809] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.440947] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.447671] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00b541f3-9964-40ec-91e3-e2aa8166f007 in Status: IN_PROGRESS for 2s [ 791.462381] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 79476966-6948-4fb4-811c-c9f8cee63da2 in Status: IN_PROGRESS for 2s [ 791.500300] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.500506] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.500596] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.500885] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.501104] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.539594] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a685dbf9-8823-4364-9677-e8aff5bd2a59 in Status: IN_PROGRESS for 2s [ 791.575279] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8203f522-bc6e-4e14-b117-5565f4e3f7fa with status ACTIVE [ 791.575279] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.575279] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.575279] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.575279] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.575279] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.575279] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.575279] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.575279] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.575279] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.575621] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.575621] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.575621] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.575714] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.575962] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.576071] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.576187] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8203f522-bc6e-4e14-b117-5565f4e3f7fa is going to be updated. [ 791.577699] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f2ac94a-4beb-4e79-8490-47989224cf9f taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.577848] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.622194] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.623056] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.623254] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.624137] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.624137] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.624137] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8203f522-bc6e-4e14-b117-5565f4e3f7fa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.634908] env[67094]: INFO networking_nsxv3.common.synchronization [req-b366dba5-b707-42e2-9927-c48d916f56bf req-bd2112b1-2ca5-49ff-a089-905f62facffd tempest-ServersTestFqdnHostnames-1054617166 tempest-ServersTestFqdnHostnames-1054617166-project-member] Enqueued Resource ID: 0c6a3072-604c-444a-b4d4-9ed06e060bef with Priority: HIGHEST for action security_group_members [ 791.635927] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0c6a3072-604c-444a-b4d4-9ed06e060bef with Priority: HIGHEST for action security_group_members [ 791.635927] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0c6a3072-604c-444a-b4d4-9ed06e060bef taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.635927] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0c6a3072-604c-444a-b4d4-9ed06e060bef" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.635927] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0c6a3072-604c-444a-b4d4-9ed06e060bef" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.636235] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0c6a3072-604c-444a-b4d4-9ed06e060bef" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.636266] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.636391] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.636480] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.636799] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.636799] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.636891] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0c6a3072-604c-444a-b4d4-9ed06e060bef',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 791.648119] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.648119] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.648119] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.648302] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.648357] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.648774] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0881101-1be1-4dbf-ac18-2d54a689202c is going to be updated. [ 791.684407] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.684407] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.684407] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.684596] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.684738] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.697523] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0881101-1be1-4dbf-ac18-2d54a689202c in Status: IN_PROGRESS for 2s [ 791.947432] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 791.947432] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 791.947432] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 791.947432] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 791.947432] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 791.947432] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1bb9bd0b-73a9-4e91-b9f6-f782acce595d already deleted. [ 791.947432] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1bb9bd0b-73a9-4e91-b9f6-f782acce595d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.000515] env[67094]: INFO networking_nsxv3.common.synchronization [req-22ceb226-c48b-4a54-a38d-56fc8b580950 req-7169d3e0-f902-4936-b7f6-d247c93115a8 tempest-ImagesTestJSON-2097058733 tempest-ImagesTestJSON-2097058733-project-member] Enqueued Resource ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa with Priority: HIGHEST for action security_group_members [ 792.002123] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa with Priority: HIGHEST for action security_group_members [ 792.002551] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-84918628-8f8e-4d25-9c0f-17cccb58ebfa taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.002949] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.002949] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.003170] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.003259] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.003360] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.003415] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.003690] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.003690] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.003822] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('84918628-8f8e-4d25-9c0f-17cccb58ebfa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.147860] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.147860] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.147860] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.147860] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.172717] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.173056] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.173187] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.173255] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.173580] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.173644] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.173710] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c6a3072-604c-444a-b4d4-9ed06e060bef is going to be updated. [ 792.207701] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.208009] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.208129] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.208680] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.208680] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.218460] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c6a3072-604c-444a-b4d4-9ed06e060bef in Status: IN_PROGRESS for 2s [ 792.405791] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock network-842 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.405791] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "network-842" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.405791] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "network-842" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.405791] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "network-842" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.405791] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.405791] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.406689] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.407101] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.407398] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.407749] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 792.409738] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 792.409738] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 792.409738] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 792.409738] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 792.409738] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 792.409738] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 792.429147] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 792.429691] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 792.429996] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 792.430479] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "network-842" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.432049] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock port-17a13018-4be6-47ad-890a-0f5f343a539b taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.432049] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "port-17a13018-4be6-47ad-890a-0f5f343a539b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.432049] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "port-17a13018-4be6-47ad-890a-0f5f343a539b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.432049] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "port-17a13018-4be6-47ad-890a-0f5f343a539b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.432049] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('17a13018-4be6-47ad-890a-0f5f343a539b',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.466434] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f in Status: SUCCESS [ 792.466707] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.466890] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.467131] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.467330] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.468319] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.468319] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.468319] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.468319] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.468319] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f2ac94a-4beb-4e79-8490-47989224cf9f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.507052] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.507296] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.507296] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.507478] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.507557] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.507750] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.507858] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.507950] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.508078] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.508160] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.508252] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa is going to be deleted. [ 792.575655] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.575869] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.575984] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.576325] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.576448] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.576559] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.663603] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 763488f4-7445-4094-9732-5af84c8ba064 in Status: SUCCESS [ 792.664267] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-763488f4-7445-4094-9732-5af84c8ba064" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.664267] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-763488f4-7445-4094-9732-5af84c8ba064" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.664267] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-763488f4-7445-4094-9732-5af84c8ba064" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.664267] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('763488f4-7445-4094-9732-5af84c8ba064',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 792.822858] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: eb77eddf-2e1d-485c-bfe8-67d4c174dc73 in Status: SUCCESS [ 792.822858] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-eb77eddf-2e1d-485c-bfe8-67d4c174dc73" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.934352] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.934584] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.934708] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.934995] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.936110] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.936110] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Segment Port 17a13018-4be6-47ad-890a-0f5f343a539b not found, creating... [ 792.936110] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.936110] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.936110] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.936300] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.936300] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.936779] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.936779] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.936911] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.937024] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.937152] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.937292] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Resource: SegmentPort with ID: 17a13018-4be6-47ad-890a-0f5f343a539b is going to be created. [ 792.959617] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 792.959850] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 792.960581] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 792.960706] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 792.961128] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.961291] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "port-17a13018-4be6-47ad-890a-0f5f343a539b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 792.972350] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0f2ac94a-4beb-4e79-8490-47989224cf9f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.002849] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7861002-4b91-437c-8519-9140d1a3bd82 in Status: SUCCESS [ 793.003113] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.003878] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 763488f4-7445-4094-9732-5af84c8ba064 in Status: SUCCESS [ 793.004064] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-763488f4-7445-4094-9732-5af84c8ba064" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.004597] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.004812] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.005011] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.005131] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.005195] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.005354] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.005433] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.005545] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7861002-4b91-437c-8519-9140d1a3bd82',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.006329] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-763488f4-7445-4094-9732-5af84c8ba064" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.006496] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-763488f4-7445-4094-9732-5af84c8ba064" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.006653] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.006754] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.006811] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.006951] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.007134] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.007261] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('763488f4-7445-4094-9732-5af84c8ba064',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.166986] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-763488f4-7445-4094-9732-5af84c8ba064 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.167337] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-763488f4-7445-4094-9732-5af84c8ba064" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.311223] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 in Status: SUCCESS [ 793.311223] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.348385] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae59884c-acbd-4c88-8cdb-fd8d14c95621 in Status: SUCCESS [ 793.348385] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae59884c-acbd-4c88-8cdb-fd8d14c95621" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.348385] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae59884c-acbd-4c88-8cdb-fd8d14c95621" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.348636] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae59884c-acbd-4c88-8cdb-fd8d14c95621" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.349847] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.349847] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.349847] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.349847] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.349847] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.349847] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae59884c-acbd-4c88-8cdb-fd8d14c95621" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.349847] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('ae59884c-acbd-4c88-8cdb-fd8d14c95621',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.413374] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c49f7fe8-62a6-4df5-90fb-465116c226a3 in Status: SUCCESS [ 793.414180] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c49f7fe8-62a6-4df5-90fb-465116c226a3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.414446] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6b8aa78a-ad3e-4d9d-94d1-2156bff23176 in Status: SUCCESS [ 793.414814] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b8aa78a-ad3e-4d9d-94d1-2156bff23176" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.465044] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0ee9080c-8cce-48e3-86d7-285fa4431dd0 in Status: SUCCESS [ 793.465044] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.467170] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00b541f3-9964-40ec-91e3-e2aa8166f007 in Status: SUCCESS [ 793.467714] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00b541f3-9964-40ec-91e3-e2aa8166f007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.474145] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0f2ac94a-4beb-4e79-8490-47989224cf9f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.484944] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 79476966-6948-4fb4-811c-c9f8cee63da2 in Status: SUCCESS [ 793.485421] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.512450] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f7861002-4b91-437c-8519-9140d1a3bd82',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.514074] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('763488f4-7445-4094-9732-5af84c8ba064',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.552537] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a685dbf9-8823-4364-9677-e8aff5bd2a59 in Status: SUCCESS [ 793.552791] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.709541] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0881101-1be1-4dbf-ac18-2d54a689202c in Status: SUCCESS [ 793.709786] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.710061] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.710234] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.710483] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.710665] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.710665] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.710796] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.710848] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.710899] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.710998] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.774169] env[67094]: INFO networking_nsxv3.common.synchronization [req-22ceb226-c48b-4a54-a38d-56fc8b580950 req-fd5b723a-3f8b-4d8b-829b-7d41289b0d33 service nova] Enqueued Resource ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa with Priority: HIGHEST for action security_group_rules [ 793.774169] env[67094]: INFO networking_nsxv3.common.synchronization [req-22ceb226-c48b-4a54-a38d-56fc8b580950 req-fd5b723a-3f8b-4d8b-829b-7d41289b0d33 service nova] Enqueued Resource ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa with Priority: HIGHEST for action security_group_members [ 793.774169] env[67094]: INFO networking_nsxv3.common.synchronization [req-22ceb226-c48b-4a54-a38d-56fc8b580950 req-fd5b723a-3f8b-4d8b-829b-7d41289b0d33 service nova] Enqueued Resource ID: 17a13018-4be6-47ad-890a-0f5f343a539b with Priority: HIGHEST for action port [ 793.774169] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa with Priority: HIGHEST for action security_group_rules [ 793.774169] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa with Priority: HIGHEST for action security_group_members [ 793.774169] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17a13018-4be6-47ad-890a-0f5f343a539b with Priority: HIGHEST for action port [ 793.774502] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-84918628-8f8e-4d25-9c0f-17cccb58ebfa taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.774588] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.774647] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.774846] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.774924] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('84918628-8f8e-4d25-9c0f-17cccb58ebfa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.776809] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-84918628-8f8e-4d25-9c0f-17cccb58ebfa taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.777027] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.777108] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.777357] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.777531] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.777629] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.777694] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.777881] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.778044] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.778136] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('84918628-8f8e-4d25-9c0f-17cccb58ebfa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.779377] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-17a13018-4be6-47ad-890a-0f5f343a539b taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.779455] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-17a13018-4be6-47ad-890a-0f5f343a539b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.779847] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-17a13018-4be6-47ad-890a-0f5f343a539b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.779847] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-17a13018-4be6-47ad-890a-0f5f343a539b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.779847] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('17a13018-4be6-47ad-890a-0f5f343a539b',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.851219] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('ae59884c-acbd-4c88-8cdb-fd8d14c95621',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 793.980017] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 793.980017] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 793.980017] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 793.980017] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 793.980017] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 793.980017] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f is going to be updated. [ 794.016413] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f7861002-4b91-437c-8519-9140d1a3bd82',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.018535] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.018673] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.018732] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.019180] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.019384] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.020723] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('763488f4-7445-4094-9732-5af84c8ba064',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.031661] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f in Status: IN_PROGRESS for 2s [ 794.217081] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0881101-1be1-4dbf-ac18-2d54a689202c taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.217525] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.217525] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.217525] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.217715] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.217850] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.217906] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.218121] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.218231] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.218309] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.218475] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0881101-1be1-4dbf-ac18-2d54a689202c taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.218550] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.218598] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.218744] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.218892] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.219353] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.219353] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.219353] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.219353] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.219689] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.219875] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.239134] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0c6a3072-604c-444a-b4d4-9ed06e060bef in Status: SUCCESS [ 794.239372] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0c6a3072-604c-444a-b4d4-9ed06e060bef deletion is rescheduled due to dependency. [ 794.239549] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0c6a3072-604c-444a-b4d4-9ed06e060bef" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.282656] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('84918628-8f8e-4d25-9c0f-17cccb58ebfa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.282960] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-84918628-8f8e-4d25-9c0f-17cccb58ebfa taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.283189] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.285695] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 17a13018-4be6-47ad-890a-0f5f343a539b with status ACTIVE [ 794.286178] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.286368] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.286491] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.287445] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.287585] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.287916] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.288242] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.288368] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.288674] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.288852] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.289222] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.289378] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.289513] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.289753] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.289827] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.289960] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 17a13018-4be6-47ad-890a-0f5f343a539b is going to be updated. [ 794.322299] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.322299] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.322299] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.323533] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.323533] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.323533] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-17a13018-4be6-47ad-890a-0f5f343a539b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.353261] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for ae59884c-acbd-4c88-8cdb-fd8d14c95621: rpc.has_security_group_logging(os_id): False [ 794.378759] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.378903] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.378969] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.379218] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.379298] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.379776] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.379897] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.379897] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.380061] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.380137] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.380223] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ae59884c-acbd-4c88-8cdb-fd8d14c95621 is going to be created. [ 794.460124] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.460378] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.460467] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.460723] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.460953] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.479027] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae59884c-acbd-4c88-8cdb-fd8d14c95621 in Status: IN_PROGRESS for 2s [ 794.492660] env[67094]: INFO networking_nsxv3.common.synchronization [req-adc7fee8-f659-46eb-81f4-ba2b6a414164 req-5a05ff2d-6a2e-47fc-a84f-cc236cc5ad74 tempest-ServersTestManualDisk-1900155527 tempest-ServersTestManualDisk-1900155527-project-member] Enqueued Resource ID: 6b8aa78a-ad3e-4d9d-94d1-2156bff23176 with Priority: HIGHEST for action security_group_members [ 794.493353] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b8aa78a-ad3e-4d9d-94d1-2156bff23176 with Priority: HIGHEST for action security_group_members [ 794.493650] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-6b8aa78a-ad3e-4d9d-94d1-2156bff23176 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.493951] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6b8aa78a-ad3e-4d9d-94d1-2156bff23176" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.493951] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6b8aa78a-ad3e-4d9d-94d1-2156bff23176" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.495539] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6b8aa78a-ad3e-4d9d-94d1-2156bff23176" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.495719] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.495869] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.495919] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.498068] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.498196] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.498462] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6b8aa78a-ad3e-4d9d-94d1-2156bff23176',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.522595] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.522829] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.522829] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.523402] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.523402] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.523402] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7861002-4b91-437c-8519-9140d1a3bd82 is going to be updated. [ 794.525289] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.525462] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.525513] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.525654] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.525736] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.525827] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 763488f4-7445-4094-9732-5af84c8ba064 is going to be updated. [ 794.572791] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.572958] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.573052] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.573295] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.573399] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.575354] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.575810] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.575810] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.575810] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.576016] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.593634] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7861002-4b91-437c-8519-9140d1a3bd82 in Status: IN_PROGRESS for 2s [ 794.594393] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 763488f4-7445-4094-9732-5af84c8ba064 in Status: IN_PROGRESS for 2s [ 794.726213] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c0881101-1be1-4dbf-ac18-2d54a689202c: rpc.has_security_group_logging(os_id): False [ 794.746309] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.746597] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.746653] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.747149] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.769060] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.769386] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.769541] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.769605] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.769936] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.770575] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.770819] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.770948] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.771023] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.771217] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.771299] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.771507] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.771606] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.771661] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.771802] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.771873] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.772618] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0881101-1be1-4dbf-ac18-2d54a689202c is going to be updated. [ 794.787115] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('84918628-8f8e-4d25-9c0f-17cccb58ebfa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 794.838984] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 794.839229] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 794.839310] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 794.839590] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 794.839800] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 794.858057] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0881101-1be1-4dbf-ac18-2d54a689202c in Status: IN_PROGRESS for 2s [ 795.004389] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.004389] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.004389] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.004389] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.004389] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.004389] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.004389] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.004389] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.004389] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.004389] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.004389] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b8aa78a-ad3e-4d9d-94d1-2156bff23176 is going to be updated. [ 795.037018] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.037018] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.037018] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.037018] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.037018] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.051939] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b8aa78a-ad3e-4d9d-94d1-2156bff23176 in Status: IN_PROGRESS for 2s [ 795.290658] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.291080] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.291180] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.291866] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.291972] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.292078] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa is going to be created. [ 795.337024] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 795.337261] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 795.337261] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 795.337523] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 795.337770] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 795.353602] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa in Status: UNINITIALIZED for 2s [ 796.046031] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f in Status: SUCCESS [ 796.046382] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.046647] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.046958] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.047310] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.047432] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.047545] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.047787] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.047917] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.048174] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.048326] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0f2ac94a-4beb-4e79-8490-47989224cf9f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.494124] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: ae59884c-acbd-4c88-8cdb-fd8d14c95621 in Status: SUCCESS [ 796.494474] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ae59884c-acbd-4c88-8cdb-fd8d14c95621" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.550825] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f2ac94a-4beb-4e79-8490-47989224cf9f taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.550825] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.551039] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.551177] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.551609] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.551609] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.552734] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.552734] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.552888] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.552976] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.553231] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f2ac94a-4beb-4e79-8490-47989224cf9f taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.553402] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.553473] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.553680] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.553968] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.554067] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.554178] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.554429] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.554520] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.554609] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.554746] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0f2ac94a-4beb-4e79-8490-47989224cf9f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.606145] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 763488f4-7445-4094-9732-5af84c8ba064 in Status: SUCCESS [ 796.606145] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-763488f4-7445-4094-9732-5af84c8ba064" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.608361] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-763488f4-7445-4094-9732-5af84c8ba064" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.608361] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-763488f4-7445-4094-9732-5af84c8ba064" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.608361] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.608361] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.608361] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.608361] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.608361] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.608361] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-763488f4-7445-4094-9732-5af84c8ba064" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.608361] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('763488f4-7445-4094-9732-5af84c8ba064',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.612165] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7861002-4b91-437c-8519-9140d1a3bd82 in Status: SUCCESS [ 796.612165] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.612518] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.612945] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.614017] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.614017] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.614017] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.614017] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.614322] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.614525] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.615106] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7861002-4b91-437c-8519-9140d1a3bd82 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.615106] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.615106] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.616068] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.616068] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 796.616068] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 796.616068] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 796.616292] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 796.616292] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.616805] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 796.616805] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f7861002-4b91-437c-8519-9140d1a3bd82',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 796.879148] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0881101-1be1-4dbf-ac18-2d54a689202c in Status: SUCCESS [ 796.879604] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.059945] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0f2ac94a-4beb-4e79-8490-47989224cf9f: rpc.has_security_group_logging(os_id): False [ 797.071029] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6b8aa78a-ad3e-4d9d-94d1-2156bff23176 in Status: SUCCESS [ 797.071029] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6b8aa78a-ad3e-4d9d-94d1-2156bff23176 deletion is rescheduled due to dependency. [ 797.071029] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6b8aa78a-ad3e-4d9d-94d1-2156bff23176" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.089020] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.089173] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.089663] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.091524] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.120533] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.120533] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.120533] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.120533] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.120533] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.120533] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.120533] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.120533] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.120833] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.120833] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.120833] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.121490] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.121490] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.121490] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.121490] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.121490] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.121490] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f is going to be updated. [ 797.122682] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('763488f4-7445-4094-9732-5af84c8ba064',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.123921] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f7861002-4b91-437c-8519-9140d1a3bd82: rpc.has_security_group_logging(os_id): False [ 797.163811] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.163811] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.163811] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.164157] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.195290] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.195678] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.196082] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.196194] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.196737] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.196851] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.197274] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.198364] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.198364] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.198364] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.198518] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.198681] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.198806] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.198910] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.200669] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.200669] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.200669] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f7861002-4b91-437c-8519-9140d1a3bd82 is going to be updated. [ 797.244022] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.244782] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.244934] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.245342] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.245574] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.267603] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f in Status: IN_PROGRESS for 2s [ 797.470546] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.470869] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.470946] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.471284] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.471528] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.473878] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa in Status: SUCCESS [ 797.474260] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.475090] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.475429] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.476435] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.476689] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.476819] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.477202] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.477828] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.478068] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.478259] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('84918628-8f8e-4d25-9c0f-17cccb58ebfa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 797.496472] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7861002-4b91-437c-8519-9140d1a3bd82 in Status: IN_PROGRESS for 2s [ 797.627497] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 763488f4-7445-4094-9732-5af84c8ba064: rpc.has_security_group_logging(os_id): False [ 797.656595] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.656906] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.657027] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.657266] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.657357] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.657693] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.657819] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.657882] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.658123] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.658225] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.658336] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 763488f4-7445-4094-9732-5af84c8ba064 is going to be updated. [ 797.761170] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.761170] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.761170] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.761327] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.761358] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.777076] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 763488f4-7445-4094-9732-5af84c8ba064 in Status: IN_PROGRESS for 2s [ 797.981090] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-84918628-8f8e-4d25-9c0f-17cccb58ebfa taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.981265] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.981350] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.981921] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.981921] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.982221] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.982221] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.982317] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.982444] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.982493] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.982708] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-84918628-8f8e-4d25-9c0f-17cccb58ebfa taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.982834] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.982919] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.983145] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.983327] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 797.983449] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 797.983521] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 797.983719] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 797.983796] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.983900] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 797.984009] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('84918628-8f8e-4d25-9c0f-17cccb58ebfa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 798.486340] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 84918628-8f8e-4d25-9c0f-17cccb58ebfa: rpc.has_security_group_logging(os_id): False [ 798.506079] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.506394] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.506394] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.506478] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.506569] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.506777] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.506876] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.506939] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.507275] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.507356] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.507536] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.507631] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.507693] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.507835] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.507909] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.508290] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.508290] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.508447] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.508447] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.508510] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.508592] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa is going to be created. [ 798.585366] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 798.586154] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 798.586154] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 798.586154] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 798.586154] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 798.608496] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa in Status: IN_PROGRESS for 2s [ 799.198513] env[67094]: INFO networking_nsxv3.common.synchronization [None req-58318b71-09df-4238-8ba7-6ccb9ce3ff54 None None] Enqueued Resource ID: 2086f110-7c86-46a9-9a1f-150d3629fd7c with Priority: HIGHEST for action port [ 799.199109] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2086f110-7c86-46a9-9a1f-150d3629fd7c with Priority: HIGHEST for action port [ 799.199428] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-2086f110-7c86-46a9-9a1f-150d3629fd7c taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.199548] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2086f110-7c86-46a9-9a1f-150d3629fd7c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.199617] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2086f110-7c86-46a9-9a1f-150d3629fd7c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.199868] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2086f110-7c86-46a9-9a1f-150d3629fd7c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.199951] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2086f110-7c86-46a9-9a1f-150d3629fd7c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.291300] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f in Status: SUCCESS [ 799.291716] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.514185] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7861002-4b91-437c-8519-9140d1a3bd82 in Status: SUCCESS [ 799.514635] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.514635] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.516302] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.516302] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f7861002-4b91-437c-8519-9140d1a3bd82',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 799.711968] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2086f110-7c86-46a9-9a1f-150d3629fd7c [ 799.712293] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 799.712526] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 799.712526] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 799.712774] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 799.712774] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.712912] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2086f110-7c86-46a9-9a1f-150d3629fd7c already deleted. [ 799.713122] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2086f110-7c86-46a9-9a1f-150d3629fd7c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 799.792147] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 763488f4-7445-4094-9732-5af84c8ba064 in Status: SUCCESS [ 799.792464] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-763488f4-7445-4094-9732-5af84c8ba064" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.019247] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7861002-4b91-437c-8519-9140d1a3bd82 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.019627] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.020262] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.020262] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.020262] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.020262] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.020262] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.020514] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.020514] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.020645] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.020691] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f7861002-4b91-437c-8519-9140d1a3bd82',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.525769] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7861002-4b91-437c-8519-9140d1a3bd82 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.525769] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.525769] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.525769] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.525769] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.525769] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.525769] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.525769] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.525769] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.525769] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.525769] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7861002-4b91-437c-8519-9140d1a3bd82 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.525769] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.525769] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.526679] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.526838] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 800.528470] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 800.528470] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 800.528470] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 800.528470] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.528470] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 800.528470] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f7861002-4b91-437c-8519-9140d1a3bd82',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 800.620490] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa in Status: SUCCESS [ 800.620765] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.032181] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f7861002-4b91-437c-8519-9140d1a3bd82: rpc.has_security_group_logging(os_id): False [ 801.056126] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.056376] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.056471] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.056711] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.056827] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.057067] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.057395] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.057395] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.057534] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.057534] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.057740] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.057942] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.057942] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.058092] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.059038] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.059695] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.059872] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.059979] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.060323] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.060518] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.060669] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f7861002-4b91-437c-8519-9140d1a3bd82 is going to be updated. [ 801.127443] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 801.127618] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 801.127685] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 801.127901] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 801.128121] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 801.147539] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7861002-4b91-437c-8519-9140d1a3bd82 in Status: IN_PROGRESS for 2s [ 802.043012] env[67094]: INFO networking_nsxv3.common.synchronization [None req-5bdc2155-8372-4545-87cc-225502a9646e None None] Enqueued Resource ID: 9d2cc860-de64-47de-bb31-48e137fb5c3e with Priority: HIGHEST for action port [ 802.044196] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9d2cc860-de64-47de-bb31-48e137fb5c3e with Priority: HIGHEST for action port [ 802.045075] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-9d2cc860-de64-47de-bb31-48e137fb5c3e taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.045355] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9d2cc860-de64-47de-bb31-48e137fb5c3e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.045666] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9d2cc860-de64-47de-bb31-48e137fb5c3e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.046185] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9d2cc860-de64-47de-bb31-48e137fb5c3e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.046378] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9d2cc860-de64-47de-bb31-48e137fb5c3e',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.549032] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9d2cc860-de64-47de-bb31-48e137fb5c3e [ 802.550187] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.550187] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.550187] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.550187] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.550187] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.550522] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9d2cc860-de64-47de-bb31-48e137fb5c3e already deleted. [ 802.550522] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9d2cc860-de64-47de-bb31-48e137fb5c3e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 802.873504] env[67094]: INFO networking_nsxv3.common.synchronization [None req-2eb0f7a4-edd8-4c7d-92ff-70f08877cfb9 None None] Enqueued Resource ID: 73cccfd4-c0c8-47d9-9fd7-3cf09f2c6f60 with Priority: HIGHEST for action port [ 802.874739] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 73cccfd4-c0c8-47d9-9fd7-3cf09f2c6f60 with Priority: HIGHEST for action port [ 802.875238] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-73cccfd4-c0c8-47d9-9fd7-3cf09f2c6f60 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.875428] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-73cccfd4-c0c8-47d9-9fd7-3cf09f2c6f60" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.875529] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-73cccfd4-c0c8-47d9-9fd7-3cf09f2c6f60" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.876056] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-73cccfd4-c0c8-47d9-9fd7-3cf09f2c6f60" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.876243] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('73cccfd4-c0c8-47d9-9fd7-3cf09f2c6f60',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 802.892484] env[67094]: INFO networking_nsxv3.common.synchronization [None req-ca3c7163-9d89-4a69-ac33-23124e32560f None None] Enqueued Resource ID: 88c71840-7bf7-43e4-80d8-2eaf3e7b9f8b with Priority: HIGHEST for action port [ 802.893147] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 88c71840-7bf7-43e4-80d8-2eaf3e7b9f8b with Priority: HIGHEST for action port [ 802.893942] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-88c71840-7bf7-43e4-80d8-2eaf3e7b9f8b taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 802.893942] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-88c71840-7bf7-43e4-80d8-2eaf3e7b9f8b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 802.894185] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-88c71840-7bf7-43e4-80d8-2eaf3e7b9f8b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 802.894426] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-88c71840-7bf7-43e4-80d8-2eaf3e7b9f8b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 802.894547] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('88c71840-7bf7-43e4-80d8-2eaf3e7b9f8b',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.167096] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7861002-4b91-437c-8519-9140d1a3bd82 in Status: SUCCESS [ 803.167096] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.167532] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.167613] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.167757] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f7861002-4b91-437c-8519-9140d1a3bd82',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.381630] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 73cccfd4-c0c8-47d9-9fd7-3cf09f2c6f60 [ 803.382041] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.384348] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.384348] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.384348] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.384348] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.384348] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:73cccfd4-c0c8-47d9-9fd7-3cf09f2c6f60 already deleted. [ 803.384348] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-73cccfd4-c0c8-47d9-9fd7-3cf09f2c6f60" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.397746] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 88c71840-7bf7-43e4-80d8-2eaf3e7b9f8b [ 803.397746] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.397746] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.397746] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.397746] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.397746] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.397746] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:88c71840-7bf7-43e4-80d8-2eaf3e7b9f8b already deleted. [ 803.398188] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-88c71840-7bf7-43e4-80d8-2eaf3e7b9f8b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.656023] env[67094]: INFO networking_nsxv3.common.synchronization [req-b0fb984a-4509-493a-8a6c-a5f43c004661 req-20a2523a-e8eb-4c63-b232-2ac6e73a5547 tempest-ServerGroupTestJSON-625213619 tempest-ServerGroupTestJSON-625213619-project-member] Enqueued Resource ID: c49f7fe8-62a6-4df5-90fb-465116c226a3 with Priority: HIGHEST for action security_group_members [ 803.656023] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c49f7fe8-62a6-4df5-90fb-465116c226a3 with Priority: HIGHEST for action security_group_members [ 803.656752] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-c49f7fe8-62a6-4df5-90fb-465116c226a3 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.657059] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c49f7fe8-62a6-4df5-90fb-465116c226a3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.657228] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c49f7fe8-62a6-4df5-90fb-465116c226a3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.657516] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c49f7fe8-62a6-4df5-90fb-465116c226a3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.659935] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.659935] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.659935] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.659935] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.659935] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.659935] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c49f7fe8-62a6-4df5-90fb-465116c226a3',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.678211] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7861002-4b91-437c-8519-9140d1a3bd82 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.678211] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.678211] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.678211] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.678211] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.678211] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.678211] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.678211] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.678211] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.678211] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.678211] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f7861002-4b91-437c-8519-9140d1a3bd82',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 803.968076] env[67094]: INFO networking_nsxv3.common.synchronization [req-24ca62cd-e4c2-40a8-b2e2-53a697fc3870 req-c55a93e2-b2b1-45aa-b873-725bf53a9d68 tempest-VolumesAdminNegativeTest-1228606920 tempest-VolumesAdminNegativeTest-1228606920-project-member] Enqueued Resource ID: 087ace1a-6d14-459c-b6b4-b5fb31f2020d with Priority: HIGHEST for action security_group_members [ 803.968658] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 087ace1a-6d14-459c-b6b4-b5fb31f2020d with Priority: HIGHEST for action security_group_members [ 803.968970] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-087ace1a-6d14-459c-b6b4-b5fb31f2020d taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.970112] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-087ace1a-6d14-459c-b6b4-b5fb31f2020d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.970203] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-087ace1a-6d14-459c-b6b4-b5fb31f2020d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.970542] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-087ace1a-6d14-459c-b6b4-b5fb31f2020d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.970752] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 803.970884] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 803.970971] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 803.971210] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 803.971303] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 803.971401] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('087ace1a-6d14-459c-b6b4-b5fb31f2020d',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.162733] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.163042] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.163170] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.163542] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.163655] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.163924] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.164114] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.164176] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.164321] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.164398] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.164534] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c49f7fe8-62a6-4df5-90fb-465116c226a3 is going to be updated. [ 804.182185] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7861002-4b91-437c-8519-9140d1a3bd82 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.182498] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.182498] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.182642] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.182806] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.182921] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.182979] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.183159] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.183256] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.183356] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.183524] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7861002-4b91-437c-8519-9140d1a3bd82 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.183613] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.183663] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.184015] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.184015] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.184128] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.184128] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.184225] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.184299] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.184378] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.184501] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f7861002-4b91-437c-8519-9140d1a3bd82',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.199563] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.199563] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.199563] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.199962] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.200049] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.211102] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c49f7fe8-62a6-4df5-90fb-465116c226a3 in Status: IN_PROGRESS for 2s [ 804.475654] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.475654] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.475654] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.475654] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.475654] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.475654] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.475654] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.476013] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.476013] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.476013] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.476141] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 087ace1a-6d14-459c-b6b4-b5fb31f2020d already deleted. [ 804.476661] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-087ace1a-6d14-459c-b6b4-b5fb31f2020d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.534050] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock network-547 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.534263] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "network-547" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.534383] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "network-547" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.534708] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "network-547" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.535596] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.535596] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.535596] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.535596] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.535596] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.535862] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 804.535898] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 804.536011] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 804.536113] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 804.536209] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 804.536312] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 804.536443] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 804.556210] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 804.556210] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 804.556210] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 804.556210] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "network-547" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.556210] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock port-5a671de4-45f6-4e98-abe7-e6602e639bd7 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.556598] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "port-5a671de4-45f6-4e98-abe7-e6602e639bd7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.556598] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "port-5a671de4-45f6-4e98-abe7-e6602e639bd7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.556898] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "port-5a671de4-45f6-4e98-abe7-e6602e639bd7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.556898] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a671de4-45f6-4e98-abe7-e6602e639bd7',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 804.688238] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f7861002-4b91-437c-8519-9140d1a3bd82: rpc.has_security_group_logging(os_id): False [ 804.707147] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.707574] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.707574] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.707739] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.707807] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.708352] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.708352] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.708352] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.708681] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.708681] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.708893] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.708969] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.709057] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.709289] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.709371] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.709577] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.710123] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.710123] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.710123] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.710123] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.710265] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f7861002-4b91-437c-8519-9140d1a3bd82 is going to be updated. [ 804.776615] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 804.776763] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 804.776836] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 804.777070] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 804.777212] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 804.798946] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7861002-4b91-437c-8519-9140d1a3bd82 in Status: IN_PROGRESS for 2s [ 805.060470] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.060470] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.060470] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.060470] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.060470] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.060752] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Segment Port 5a671de4-45f6-4e98-abe7-e6602e639bd7 not found, creating... [ 805.060891] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.061060] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.061174] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.061385] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.061597] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.061791] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.061942] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.062151] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.062396] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.062541] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.062669] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Resource: SegmentPort with ID: 5a671de4-45f6-4e98-abe7-e6602e639bd7 is going to be created. [ 805.086557] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.086680] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.086804] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.087302] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.087302] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.087486] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "port-5a671de4-45f6-4e98-abe7-e6602e639bd7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.440931] env[67094]: INFO networking_nsxv3.common.synchronization [None req-1e47ac89-94b7-4e58-9e13-b2d0103eb03a tempest-ServerActionsTestOtherB-1168296312 tempest-ServerActionsTestOtherB-1168296312-project-member] Enqueued Resource ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 with Priority: HIGHEST for action security_group_rules [ 805.441714] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 with Priority: HIGHEST for action security_group_rules [ 805.442142] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.442310] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.442404] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.442718] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.442825] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.730808] env[67094]: INFO networking_nsxv3.common.synchronization [None req-ea9c8335-ed5b-47d5-bcb7-2ca9000c3b24 tempest-ServerActionsTestOtherB-1168296312 tempest-ServerActionsTestOtherB-1168296312-project-member] Enqueued Resource ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 with Priority: HIGHEST for action security_group_rules [ 805.732517] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 with Priority: HIGHEST for action security_group_rules [ 805.732517] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.732517] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.814645] env[67094]: INFO networking_nsxv3.common.synchronization [req-24ca62cd-e4c2-40a8-b2e2-53a697fc3870 req-45beacbd-46bf-4b1a-8632-9d6a8a02586a service nova] Enqueued Resource ID: 087ace1a-6d14-459c-b6b4-b5fb31f2020d with Priority: HIGHEST for action security_group_rules [ 805.814750] env[67094]: INFO networking_nsxv3.common.synchronization [req-24ca62cd-e4c2-40a8-b2e2-53a697fc3870 req-45beacbd-46bf-4b1a-8632-9d6a8a02586a service nova] Enqueued Resource ID: 087ace1a-6d14-459c-b6b4-b5fb31f2020d with Priority: HIGHEST for action security_group_members [ 805.814801] env[67094]: INFO networking_nsxv3.common.synchronization [req-24ca62cd-e4c2-40a8-b2e2-53a697fc3870 req-45beacbd-46bf-4b1a-8632-9d6a8a02586a service nova] Enqueued Resource ID: 5a671de4-45f6-4e98-abe7-e6602e639bd7 with Priority: HIGHEST for action port [ 805.815370] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 087ace1a-6d14-459c-b6b4-b5fb31f2020d with Priority: HIGHEST for action security_group_rules [ 805.815457] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 087ace1a-6d14-459c-b6b4-b5fb31f2020d with Priority: HIGHEST for action security_group_members [ 805.815553] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5a671de4-45f6-4e98-abe7-e6602e639bd7 with Priority: HIGHEST for action port [ 805.815953] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-087ace1a-6d14-459c-b6b4-b5fb31f2020d taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.816173] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-087ace1a-6d14-459c-b6b4-b5fb31f2020d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.816173] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-087ace1a-6d14-459c-b6b4-b5fb31f2020d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.816446] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-087ace1a-6d14-459c-b6b4-b5fb31f2020d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.816534] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('087ace1a-6d14-459c-b6b4-b5fb31f2020d',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.817448] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-087ace1a-6d14-459c-b6b4-b5fb31f2020d taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.817585] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-087ace1a-6d14-459c-b6b4-b5fb31f2020d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.817664] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-087ace1a-6d14-459c-b6b4-b5fb31f2020d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.820238] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-087ace1a-6d14-459c-b6b4-b5fb31f2020d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.820238] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.820238] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.820238] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.820238] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.820238] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.820238] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('087ace1a-6d14-459c-b6b4-b5fb31f2020d',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.820238] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-5a671de4-45f6-4e98-abe7-e6602e639bd7 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.820238] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5a671de4-45f6-4e98-abe7-e6602e639bd7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.820238] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5a671de4-45f6-4e98-abe7-e6602e639bd7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.820238] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5a671de4-45f6-4e98-abe7-e6602e639bd7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.820238] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5a671de4-45f6-4e98-abe7-e6602e639bd7',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.839304] env[67094]: INFO networking_nsxv3.common.synchronization [req-395abeb3-28de-4bf0-9277-6daf67712e31 req-7aed68c0-3605-4a01-b295-29d5f7e90e2c tempest-SecurityGroupRulesTestJSON-2088080837 tempest-SecurityGroupRulesTestJSON-2088080837-project-member] Enqueued Resource ID: 9adf76ab-ea8a-43f1-83cf-3fcd878037bb with Priority: HIGHEST for action security_group_rules [ 805.839835] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9adf76ab-ea8a-43f1-83cf-3fcd878037bb with Priority: HIGHEST for action security_group_rules [ 805.841713] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9adf76ab-ea8a-43f1-83cf-3fcd878037bb taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.841868] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9adf76ab-ea8a-43f1-83cf-3fcd878037bb" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.841973] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9adf76ab-ea8a-43f1-83cf-3fcd878037bb" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.844483] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9adf76ab-ea8a-43f1-83cf-3fcd878037bb" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.844604] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9adf76ab-ea8a-43f1-83cf-3fcd878037bb',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 805.969563] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 805.969563] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 805.969563] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.969563] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.969563] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.969563] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 already deleted. [ 805.969563] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 805.969563] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 805.970543] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 805.970543] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.236583] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c49f7fe8-62a6-4df5-90fb-465116c226a3 in Status: SUCCESS [ 806.247863] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c49f7fe8-62a6-4df5-90fb-465116c226a3 deletion is rescheduled due to dependency. [ 806.247863] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c49f7fe8-62a6-4df5-90fb-465116c226a3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.301948] env[67094]: INFO networking_nsxv3.common.synchronization [None req-1fa35bb6-25a6-4a04-ad00-713be027fdec None None] Enqueued Resource ID: 684e601d-baa2-464c-9e45-8a08dd989487 with Priority: HIGHEST for action port [ 806.302648] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 684e601d-baa2-464c-9e45-8a08dd989487 with Priority: HIGHEST for action port [ 806.303899] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-684e601d-baa2-464c-9e45-8a08dd989487 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.304087] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-684e601d-baa2-464c-9e45-8a08dd989487" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.304165] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-684e601d-baa2-464c-9e45-8a08dd989487" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.304457] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-684e601d-baa2-464c-9e45-8a08dd989487" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.304674] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('684e601d-baa2-464c-9e45-8a08dd989487',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.322085] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-087ace1a-6d14-459c-b6b4-b5fb31f2020d taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.322085] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-087ace1a-6d14-459c-b6b4-b5fb31f2020d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.322085] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('087ace1a-6d14-459c-b6b4-b5fb31f2020d',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 806.323190] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5a671de4-45f6-4e98-abe7-e6602e639bd7 with status ACTIVE [ 806.323263] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.324540] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.324540] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.324540] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.324540] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.324540] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.324540] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.324540] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.325354] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.325449] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.326168] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.326168] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.326168] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.326168] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.326168] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.326364] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5a671de4-45f6-4e98-abe7-e6602e639bd7 is going to be updated. [ 806.366614] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.367944] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.367944] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.367944] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.367944] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.367944] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5a671de4-45f6-4e98-abe7-e6602e639bd7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.373515] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.373515] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.373515] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.373515] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.373515] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.373515] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9adf76ab-ea8a-43f1-83cf-3fcd878037bb already deleted. [ 806.373515] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9adf76ab-ea8a-43f1-83cf-3fcd878037bb" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.504772] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.505165] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.505165] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.505385] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.505385] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.505444] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 already deleted. [ 806.505529] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.807134] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 684e601d-baa2-464c-9e45-8a08dd989487 [ 806.807369] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 806.807489] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 806.807555] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 806.807764] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 806.807853] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.807935] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:684e601d-baa2-464c-9e45-8a08dd989487 already deleted. [ 806.808024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-684e601d-baa2-464c-9e45-8a08dd989487" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.818357] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7861002-4b91-437c-8519-9140d1a3bd82 in Status: SUCCESS [ 806.818575] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 806.828755] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('087ace1a-6d14-459c-b6b4-b5fb31f2020d',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.152286] env[67094]: INFO networking_nsxv3.common.synchronization [req-58e8a396-be75-41b6-8583-7a7e345ef591 req-db32f9b9-55e9-46ea-9804-3383bc498c64 tempest-AttachInterfacesTestJSON-1117082489 tempest-AttachInterfacesTestJSON-1117082489-project-member] Enqueued Resource ID: 882c69d3-9554-45c6-97a1-55fb0f065040 with Priority: HIGHEST for action security_group_members [ 807.152785] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 882c69d3-9554-45c6-97a1-55fb0f065040 with Priority: HIGHEST for action security_group_members [ 807.153109] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-882c69d3-9554-45c6-97a1-55fb0f065040 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.153232] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.153302] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.153502] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.153651] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.153745] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.153808] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.153951] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.154073] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.154172] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('882c69d3-9554-45c6-97a1-55fb0f065040',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 807.334255] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.334413] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.334484] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.334705] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.334798] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.334898] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 087ace1a-6d14-459c-b6b4-b5fb31f2020d is going to be created. [ 807.362669] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.362867] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.362998] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.363290] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.363502] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.375393] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 087ace1a-6d14-459c-b6b4-b5fb31f2020d in Status: UNINITIALIZED for 2s [ 807.657368] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.657368] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.657368] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.657368] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.657368] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.657368] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.657368] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.657368] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.658098] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.658098] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.658098] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 882c69d3-9554-45c6-97a1-55fb0f065040 is going to be updated. [ 807.690025] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 807.690223] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 807.690268] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 807.690743] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 807.690743] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 807.702781] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882c69d3-9554-45c6-97a1-55fb0f065040 in Status: IN_PROGRESS for 2s [ 808.271763] env[67094]: INFO networking_nsxv3.common.synchronization [None req-4b5b81aa-8061-4e65-a993-2621db409981 None None] Enqueued Resource ID: 557b75fb-66f9-4d02-b7b3-43ccc9d9872a with Priority: HIGHEST for action port [ 808.273350] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 557b75fb-66f9-4d02-b7b3-43ccc9d9872a with Priority: HIGHEST for action port [ 808.273729] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-557b75fb-66f9-4d02-b7b3-43ccc9d9872a taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.273851] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-557b75fb-66f9-4d02-b7b3-43ccc9d9872a" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.273924] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-557b75fb-66f9-4d02-b7b3-43ccc9d9872a" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.274204] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-557b75fb-66f9-4d02-b7b3-43ccc9d9872a" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.274303] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('557b75fb-66f9-4d02-b7b3-43ccc9d9872a',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 808.776985] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 557b75fb-66f9-4d02-b7b3-43ccc9d9872a [ 808.777273] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.777380] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.777454] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.777666] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.777759] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.777857] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:557b75fb-66f9-4d02-b7b3-43ccc9d9872a already deleted. [ 808.778031] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-557b75fb-66f9-4d02-b7b3-43ccc9d9872a" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.827818] env[67094]: INFO networking_nsxv3.common.synchronization [req-688b17b1-5079-4932-b149-bae55f6f1909 req-9aeab8c4-4d8e-4ff0-8c28-847db85be54e tempest-ServersTestJSON-610582052 tempest-ServersTestJSON-610582052-project-member] Enqueued Resource ID: 2bc6c42e-23db-4008-8db7-e57d76593898 with Priority: HIGHEST for action security_group_members [ 808.828405] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bc6c42e-23db-4008-8db7-e57d76593898 with Priority: HIGHEST for action security_group_members [ 808.829032] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-2bc6c42e-23db-4008-8db7-e57d76593898 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.829032] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2bc6c42e-23db-4008-8db7-e57d76593898" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.829032] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2bc6c42e-23db-4008-8db7-e57d76593898" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.829331] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2bc6c42e-23db-4008-8db7-e57d76593898" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.829522] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 808.829660] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 808.829754] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 808.830150] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 808.830150] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 808.830150] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2bc6c42e-23db-4008-8db7-e57d76593898',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.099357] env[67094]: INFO networking_nsxv3.common.synchronization [None req-dea0b992-8282-48ad-a684-0ebcf8950d02 None None] Enqueued Resource ID: 554932c1-74de-40f1-b8bc-1442d15618b7 with Priority: HIGHEST for action port [ 809.099590] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 554932c1-74de-40f1-b8bc-1442d15618b7 with Priority: HIGHEST for action port [ 809.099906] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-554932c1-74de-40f1-b8bc-1442d15618b7 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.100046] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-554932c1-74de-40f1-b8bc-1442d15618b7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.100710] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-554932c1-74de-40f1-b8bc-1442d15618b7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.102572] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-554932c1-74de-40f1-b8bc-1442d15618b7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.102654] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('554932c1-74de-40f1-b8bc-1442d15618b7',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.332118] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.332284] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.332353] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.332575] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.332664] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.332862] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.332959] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.333035] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.333189] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.333270] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.333374] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2bc6c42e-23db-4008-8db7-e57d76593898 already deleted. [ 809.333460] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2bc6c42e-23db-4008-8db7-e57d76593898" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.340048] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock network-141 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.340244] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "network-141" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.340367] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "network-141" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.340743] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "network-141" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.340996] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.341931] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.341931] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.342087] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.342208] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.342402] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 809.342667] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 809.342872] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 809.342975] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 809.343099] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 809.343205] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 809.343335] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 809.366166] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 809.366321] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 809.366439] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 809.366608] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "network-141" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.366915] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock port-bbc12fea-1048-477f-8110-de800dd78a41 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.367099] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "port-bbc12fea-1048-477f-8110-de800dd78a41" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.367214] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "port-bbc12fea-1048-477f-8110-de800dd78a41" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.367536] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "port-bbc12fea-1048-477f-8110-de800dd78a41" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.367668] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bbc12fea-1048-477f-8110-de800dd78a41',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.385516] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 087ace1a-6d14-459c-b6b4-b5fb31f2020d in Status: SUCCESS [ 809.385731] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-087ace1a-6d14-459c-b6b4-b5fb31f2020d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.386243] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-087ace1a-6d14-459c-b6b4-b5fb31f2020d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.386458] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-087ace1a-6d14-459c-b6b4-b5fb31f2020d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.386652] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.386852] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.386852] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.386976] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.387101] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.387205] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-087ace1a-6d14-459c-b6b4-b5fb31f2020d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.387298] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('087ace1a-6d14-459c-b6b4-b5fb31f2020d',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.606886] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 554932c1-74de-40f1-b8bc-1442d15618b7 [ 809.607285] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.608156] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.608156] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.608156] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.608156] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.608440] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:554932c1-74de-40f1-b8bc-1442d15618b7 already deleted. [ 809.608440] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-554932c1-74de-40f1-b8bc-1442d15618b7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.715518] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882c69d3-9554-45c6-97a1-55fb0f065040 in Status: SUCCESS [ 809.715518] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 882c69d3-9554-45c6-97a1-55fb0f065040 deletion is rescheduled due to dependency. [ 809.715518] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.870351] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.870788] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.871316] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.871316] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.871511] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.871662] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Segment Port bbc12fea-1048-477f-8110-de800dd78a41 not found, creating... [ 809.871996] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.872251] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.872375] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.872619] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.872756] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.873119] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.873311] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.873454] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.873645] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.873780] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.873952] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Resource: SegmentPort with ID: bbc12fea-1048-477f-8110-de800dd78a41 is going to be created. [ 809.889156] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-087ace1a-6d14-459c-b6b4-b5fb31f2020d taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.889447] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-087ace1a-6d14-459c-b6b4-b5fb31f2020d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.889447] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-087ace1a-6d14-459c-b6b4-b5fb31f2020d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.890675] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-087ace1a-6d14-459c-b6b4-b5fb31f2020d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.890675] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.890675] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.890675] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.890675] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.890675] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.890675] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-087ace1a-6d14-459c-b6b4-b5fb31f2020d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.890675] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-087ace1a-6d14-459c-b6b4-b5fb31f2020d taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.891048] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-087ace1a-6d14-459c-b6b4-b5fb31f2020d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.891048] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-087ace1a-6d14-459c-b6b4-b5fb31f2020d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.891048] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-087ace1a-6d14-459c-b6b4-b5fb31f2020d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.892025] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.892025] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.892025] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.892025] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.892025] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.892025] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-087ace1a-6d14-459c-b6b4-b5fb31f2020d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.892025] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('087ace1a-6d14-459c-b6b4-b5fb31f2020d',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 809.894867] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 809.895355] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 809.895355] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 809.895551] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 809.895817] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 809.896086] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "port-bbc12fea-1048-477f-8110-de800dd78a41" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.394867] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 087ace1a-6d14-459c-b6b4-b5fb31f2020d: rpc.has_security_group_logging(os_id): False [ 810.416472] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.416609] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.416696] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.416907] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.417016] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.417214] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.417327] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.417384] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.417532] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.417610] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.417811] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.417910] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.417963] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.418168] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.418256] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.418812] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.418812] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.418812] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.418993] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.418993] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.419094] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 087ace1a-6d14-459c-b6b4-b5fb31f2020d is going to be created. [ 810.494538] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.494538] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.494538] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.494538] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.494538] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.503578] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 087ace1a-6d14-459c-b6b4-b5fb31f2020d in Status: IN_PROGRESS for 2s [ 810.629360] env[67094]: INFO networking_nsxv3.common.synchronization [req-688b17b1-5079-4932-b149-bae55f6f1909 req-00d24425-3a2a-4346-b2c8-5d492f48bf50 service nova] Enqueued Resource ID: 2bc6c42e-23db-4008-8db7-e57d76593898 with Priority: HIGHEST for action security_group_rules [ 810.629360] env[67094]: INFO networking_nsxv3.common.synchronization [req-688b17b1-5079-4932-b149-bae55f6f1909 req-00d24425-3a2a-4346-b2c8-5d492f48bf50 service nova] Enqueued Resource ID: 2bc6c42e-23db-4008-8db7-e57d76593898 with Priority: HIGHEST for action security_group_members [ 810.629360] env[67094]: INFO networking_nsxv3.common.synchronization [req-688b17b1-5079-4932-b149-bae55f6f1909 req-00d24425-3a2a-4346-b2c8-5d492f48bf50 service nova] Enqueued Resource ID: bbc12fea-1048-477f-8110-de800dd78a41 with Priority: HIGHEST for action port [ 810.630659] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bc6c42e-23db-4008-8db7-e57d76593898 with Priority: HIGHEST for action security_group_rules [ 810.630659] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bc6c42e-23db-4008-8db7-e57d76593898 with Priority: HIGHEST for action security_group_members [ 810.630659] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: bbc12fea-1048-477f-8110-de800dd78a41 with Priority: HIGHEST for action port [ 810.631174] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2bc6c42e-23db-4008-8db7-e57d76593898 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.631365] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2bc6c42e-23db-4008-8db7-e57d76593898" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.631460] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2bc6c42e-23db-4008-8db7-e57d76593898" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.631678] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2bc6c42e-23db-4008-8db7-e57d76593898" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.631764] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2bc6c42e-23db-4008-8db7-e57d76593898',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.632694] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-2bc6c42e-23db-4008-8db7-e57d76593898 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.632816] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2bc6c42e-23db-4008-8db7-e57d76593898" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.632882] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2bc6c42e-23db-4008-8db7-e57d76593898" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.633083] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2bc6c42e-23db-4008-8db7-e57d76593898" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.633244] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.633361] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.633397] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.633537] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.633628] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 810.633719] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2bc6c42e-23db-4008-8db7-e57d76593898',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 810.635133] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-bbc12fea-1048-477f-8110-de800dd78a41 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 810.635241] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-bbc12fea-1048-477f-8110-de800dd78a41" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 810.635322] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-bbc12fea-1048-477f-8110-de800dd78a41" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 810.635477] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-bbc12fea-1048-477f-8110-de800dd78a41" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 810.635555] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('bbc12fea-1048-477f-8110-de800dd78a41',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.138462] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('2bc6c42e-23db-4008-8db7-e57d76593898',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.138782] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-2bc6c42e-23db-4008-8db7-e57d76593898 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.138782] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2bc6c42e-23db-4008-8db7-e57d76593898" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.140555] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port bbc12fea-1048-477f-8110-de800dd78a41 with status ACTIVE [ 811.140555] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.140555] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.140555] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.142123] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.142123] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.142123] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.142454] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.142862] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.142862] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.142862] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.143124] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.143208] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.143271] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.143429] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.143510] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.143859] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: bbc12fea-1048-477f-8110-de800dd78a41 is going to be updated. [ 811.166500] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.166658] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.166900] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.166956] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.167077] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.167240] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-bbc12fea-1048-477f-8110-de800dd78a41" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 811.647753] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('2bc6c42e-23db-4008-8db7-e57d76593898',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 811.894612] env[67094]: INFO networking_nsxv3.common.synchronization [None req-52f5079b-732c-4c64-95ac-201c654787db None None] Enqueued Resource ID: 804f45b7-8b8d-47e3-8262-05a9114644c8 with Priority: HIGHEST for action port [ 811.894612] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 804f45b7-8b8d-47e3-8262-05a9114644c8 with Priority: HIGHEST for action port [ 811.894612] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-804f45b7-8b8d-47e3-8262-05a9114644c8 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 811.894612] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-804f45b7-8b8d-47e3-8262-05a9114644c8" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 811.894612] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-804f45b7-8b8d-47e3-8262-05a9114644c8" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 811.894612] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-804f45b7-8b8d-47e3-8262-05a9114644c8" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 811.894612] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('804f45b7-8b8d-47e3-8262-05a9114644c8',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 812.149169] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.149515] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.149515] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.149981] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.149981] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.149981] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2bc6c42e-23db-4008-8db7-e57d76593898 is going to be created. [ 812.175290] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.175427] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.175530] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.175701] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.175860] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.185936] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2bc6c42e-23db-4008-8db7-e57d76593898 in Status: UNINITIALIZED for 2s [ 812.395621] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 804f45b7-8b8d-47e3-8262-05a9114644c8 [ 812.395882] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 812.396093] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 812.396197] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 812.396452] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 812.396554] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.396656] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:804f45b7-8b8d-47e3-8262-05a9114644c8 already deleted. [ 812.396739] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-804f45b7-8b8d-47e3-8262-05a9114644c8" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 812.516982] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 087ace1a-6d14-459c-b6b4-b5fb31f2020d in Status: SUCCESS [ 812.517348] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-087ace1a-6d14-459c-b6b4-b5fb31f2020d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.319669] env[67094]: INFO networking_nsxv3.common.synchronization [req-4c86dec4-b08a-413d-a024-3a3bc68fa14b req-21bdcf39-5dde-49f4-a09e-47f248a11fee tempest-ListImageFiltersTestJSON-2012211862 tempest-ListImageFiltersTestJSON-2012211862-project-member] Enqueued Resource ID: 0ee9080c-8cce-48e3-86d7-285fa4431dd0 with Priority: HIGHEST for action security_group_members [ 813.320823] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ee9080c-8cce-48e3-86d7-285fa4431dd0 with Priority: HIGHEST for action security_group_members [ 813.320823] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0ee9080c-8cce-48e3-86d7-285fa4431dd0 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.320823] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.320823] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.321119] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.321234] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.321339] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.321394] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.321588] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.321675] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.321783] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0ee9080c-8cce-48e3-86d7-285fa4431dd0',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.826687] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.826865] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.827120] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.827194] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.827445] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.827445] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.827599] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.831091] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.831091] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.831091] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.831091] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ee9080c-8cce-48e3-86d7-285fa4431dd0 is going to be updated. [ 813.861989] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.861989] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.861989] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.861989] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.861989] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.875743] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ee9080c-8cce-48e3-86d7-285fa4431dd0 in Status: IN_PROGRESS for 2s [ 813.877734] env[67094]: INFO networking_nsxv3.common.synchronization [req-9a963b76-8cf0-4152-b627-9325f50e79a4 req-44a5e4ed-a830-4a54-bb1d-439a6eed4b5f tempest-ServerRescueTestJSONUnderV235-1264300176 tempest-ServerRescueTestJSONUnderV235-1264300176-project-member] Enqueued Resource ID: a685dbf9-8823-4364-9677-e8aff5bd2a59 with Priority: HIGHEST for action security_group_members [ 813.877910] env[67094]: INFO networking_nsxv3.common.synchronization [req-9a963b76-8cf0-4152-b627-9325f50e79a4 req-44a5e4ed-a830-4a54-bb1d-439a6eed4b5f tempest-ServerRescueTestJSONUnderV235-1264300176 tempest-ServerRescueTestJSONUnderV235-1264300176-project-member] Enqueued Resource ID: a32cfdda-ac7b-4c6c-8c70-73287a5fa9f6 with Priority: HIGHEST for action security_group_members [ 813.878998] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a685dbf9-8823-4364-9677-e8aff5bd2a59 with Priority: HIGHEST for action security_group_members [ 813.878998] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a32cfdda-ac7b-4c6c-8c70-73287a5fa9f6 with Priority: HIGHEST for action security_group_members [ 813.883024] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-a685dbf9-8823-4364-9677-e8aff5bd2a59 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.883024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.883024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.883024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.883024] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.883024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.883024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.883024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.883024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.883024] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a685dbf9-8823-4364-9677-e8aff5bd2a59',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.883024] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-a32cfdda-ac7b-4c6c-8c70-73287a5fa9f6 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.883024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a32cfdda-ac7b-4c6c-8c70-73287a5fa9f6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.883024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a32cfdda-ac7b-4c6c-8c70-73287a5fa9f6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.883024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a32cfdda-ac7b-4c6c-8c70-73287a5fa9f6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.883024] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.883024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.883024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.883024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.883839] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 813.883839] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a32cfdda-ac7b-4c6c-8c70-73287a5fa9f6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.925364] env[67094]: INFO networking_nsxv3.common.synchronization [req-9a963b76-8cf0-4152-b627-9325f50e79a4 req-44a5e4ed-a830-4a54-bb1d-439a6eed4b5f tempest-ServerRescueTestJSONUnderV235-1264300176 tempest-ServerRescueTestJSONUnderV235-1264300176-project-member] Enqueued Resource ID: a32cfdda-ac7b-4c6c-8c70-73287a5fa9f6 with Priority: HIGHEST for action security_group_rules [ 813.925736] env[67094]: INFO networking_nsxv3.common.synchronization [req-9a963b76-8cf0-4152-b627-9325f50e79a4 req-44a5e4ed-a830-4a54-bb1d-439a6eed4b5f tempest-ServerRescueTestJSONUnderV235-1264300176 tempest-ServerRescueTestJSONUnderV235-1264300176-project-member] Enqueued Resource ID: a32cfdda-ac7b-4c6c-8c70-73287a5fa9f6 with Priority: HIGHEST for action security_group_members [ 813.926572] env[67094]: INFO networking_nsxv3.common.synchronization [req-9a963b76-8cf0-4152-b627-9325f50e79a4 req-44a5e4ed-a830-4a54-bb1d-439a6eed4b5f tempest-ServerRescueTestJSONUnderV235-1264300176 tempest-ServerRescueTestJSONUnderV235-1264300176-project-member] Enqueued Resource ID: a685dbf9-8823-4364-9677-e8aff5bd2a59 with Priority: HIGHEST for action security_group_rules [ 813.926572] env[67094]: INFO networking_nsxv3.common.synchronization [req-9a963b76-8cf0-4152-b627-9325f50e79a4 req-44a5e4ed-a830-4a54-bb1d-439a6eed4b5f tempest-ServerRescueTestJSONUnderV235-1264300176 tempest-ServerRescueTestJSONUnderV235-1264300176-project-member] Enqueued Resource ID: a685dbf9-8823-4364-9677-e8aff5bd2a59 with Priority: HIGHEST for action security_group_members [ 813.926572] env[67094]: INFO networking_nsxv3.common.synchronization [req-9a963b76-8cf0-4152-b627-9325f50e79a4 req-44a5e4ed-a830-4a54-bb1d-439a6eed4b5f tempest-ServerRescueTestJSONUnderV235-1264300176 tempest-ServerRescueTestJSONUnderV235-1264300176-project-member] Enqueued Resource ID: 07fc003d-db88-433f-85c3-0e029148a6c3 with Priority: HIGHEST for action port [ 813.930747] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a32cfdda-ac7b-4c6c-8c70-73287a5fa9f6 with Priority: HIGHEST for action security_group_rules [ 813.930747] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a685dbf9-8823-4364-9677-e8aff5bd2a59 with Priority: HIGHEST for action security_group_rules [ 813.930747] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07fc003d-db88-433f-85c3-0e029148a6c3 with Priority: HIGHEST for action port [ 813.930747] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a32cfdda-ac7b-4c6c-8c70-73287a5fa9f6 with Priority: HIGHEST for action security_group_members [ 813.930747] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a685dbf9-8823-4364-9677-e8aff5bd2a59 with Priority: HIGHEST for action security_group_members [ 813.930747] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a32cfdda-ac7b-4c6c-8c70-73287a5fa9f6 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.930747] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a32cfdda-ac7b-4c6c-8c70-73287a5fa9f6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.930747] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a32cfdda-ac7b-4c6c-8c70-73287a5fa9f6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.930747] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a32cfdda-ac7b-4c6c-8c70-73287a5fa9f6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.930747] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a32cfdda-ac7b-4c6c-8c70-73287a5fa9f6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.930747] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a685dbf9-8823-4364-9677-e8aff5bd2a59 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.930747] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.933200] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.933200] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.933200] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a685dbf9-8823-4364-9677-e8aff5bd2a59',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.933200] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-07fc003d-db88-433f-85c3-0e029148a6c3 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.933200] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-07fc003d-db88-433f-85c3-0e029148a6c3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.933200] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-07fc003d-db88-433f-85c3-0e029148a6c3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 813.933200] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-07fc003d-db88-433f-85c3-0e029148a6c3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 813.934123] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('07fc003d-db88-433f-85c3-0e029148a6c3',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 813.934123] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-a32cfdda-ac7b-4c6c-8c70-73287a5fa9f6 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.934123] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a32cfdda-ac7b-4c6c-8c70-73287a5fa9f6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 813.934359] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-a685dbf9-8823-4364-9677-e8aff5bd2a59 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 813.934359] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.108107] env[67094]: INFO networking_nsxv3.common.synchronization [req-95480572-39a2-49e4-8ba6-219cc154cd7d req-b925ca81-2472-4a40-b664-ec94cab7ca70 tempest-SecurityGroupRulesTestJSON-2088080837 tempest-SecurityGroupRulesTestJSON-2088080837-project-member] Enqueued Resource ID: 4aba0357-54ad-4881-aa31-d539f924f01e with Priority: HIGHEST for action security_group_rules [ 814.108744] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4aba0357-54ad-4881-aa31-d539f924f01e with Priority: HIGHEST for action security_group_rules [ 814.109323] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4aba0357-54ad-4881-aa31-d539f924f01e taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.109323] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4aba0357-54ad-4881-aa31-d539f924f01e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.109323] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4aba0357-54ad-4881-aa31-d539f924f01e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.109696] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4aba0357-54ad-4881-aa31-d539f924f01e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.109696] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4aba0357-54ad-4881-aa31-d539f924f01e',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.197388] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2bc6c42e-23db-4008-8db7-e57d76593898 in Status: SUCCESS [ 814.197577] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2bc6c42e-23db-4008-8db7-e57d76593898" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.197809] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2bc6c42e-23db-4008-8db7-e57d76593898" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.197942] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2bc6c42e-23db-4008-8db7-e57d76593898" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.198209] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.198976] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.198976] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.198976] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.198976] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.198976] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2bc6c42e-23db-4008-8db7-e57d76593898" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.198976] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('2bc6c42e-23db-4008-8db7-e57d76593898',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.385999] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a685dbf9-8823-4364-9677-e8aff5bd2a59',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.387328] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a32cfdda-ac7b-4c6c-8c70-73287a5fa9f6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.435582] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-a685dbf9-8823-4364-9677-e8aff5bd2a59 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.435710] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.436286] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-a32cfdda-ac7b-4c6c-8c70-73287a5fa9f6 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.436286] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a32cfdda-ac7b-4c6c-8c70-73287a5fa9f6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.436286] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 07fc003d-db88-433f-85c3-0e029148a6c3 with status ACTIVE [ 814.436434] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.436500] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.436537] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.437084] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.437084] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.437084] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.437304] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.437304] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.437391] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.437427] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.437603] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.437693] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.437745] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.437886] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.437959] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.438483] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 07fc003d-db88-433f-85c3-0e029148a6c3 is going to be updated. [ 814.464877] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.465115] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.465171] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.465442] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.465646] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.465843] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-07fc003d-db88-433f-85c3-0e029148a6c3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.635770] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.635980] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.636084] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.636477] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.636592] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.636745] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4aba0357-54ad-4881-aa31-d539f924f01e already deleted. [ 814.636933] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4aba0357-54ad-4881-aa31-d539f924f01e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.701665] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('2bc6c42e-23db-4008-8db7-e57d76593898',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.754811] env[67094]: INFO networking_nsxv3.common.synchronization [req-4142c187-ee73-4bf2-b6fe-0a4890a8505c req-80ca843f-c560-4609-b64a-6a307468212c tempest-ServersTestJSON-1070791530 tempest-ServersTestJSON-1070791530-project-member] Enqueued Resource ID: c0881101-1be1-4dbf-ac18-2d54a689202c with Priority: HIGHEST for action security_group_members [ 814.754811] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0881101-1be1-4dbf-ac18-2d54a689202c with Priority: HIGHEST for action security_group_members [ 814.754811] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0881101-1be1-4dbf-ac18-2d54a689202c taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.754811] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.754811] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.754811] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.756950] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 814.757739] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 814.758419] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 814.758419] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 814.758615] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 814.759126] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.889425] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a685dbf9-8823-4364-9677-e8aff5bd2a59',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 814.890468] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a32cfdda-ac7b-4c6c-8c70-73287a5fa9f6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.207110] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 2bc6c42e-23db-4008-8db7-e57d76593898: rpc.has_security_group_logging(os_id): False [ 815.231306] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.231578] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.231578] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.231781] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.231870] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.232160] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.232381] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.232381] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.232523] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.232581] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.232634] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2bc6c42e-23db-4008-8db7-e57d76593898 is going to be created. [ 815.261796] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.376730] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.376950] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.377092] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.377329] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.377550] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.394225] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2bc6c42e-23db-4008-8db7-e57d76593898 in Status: IN_PROGRESS for 2s [ 815.394973] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.394973] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.394973] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.395280] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.395280] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.395280] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a685dbf9-8823-4364-9677-e8aff5bd2a59 is going to be updated. [ 815.397032] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.397032] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.397032] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.397934] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.397934] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.397934] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a32cfdda-ac7b-4c6c-8c70-73287a5fa9f6 is going to be created. [ 815.440092] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.440482] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.440482] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.440945] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.441124] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.443195] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 815.443393] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 815.443393] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 815.443682] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 815.443782] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 815.455653] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a685dbf9-8823-4364-9677-e8aff5bd2a59 in Status: IN_PROGRESS for 2s [ 815.458835] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a32cfdda-ac7b-4c6c-8c70-73287a5fa9f6 in Status: UNINITIALIZED for 2s [ 815.767425] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 815.889886] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0ee9080c-8cce-48e3-86d7-285fa4431dd0 in Status: SUCCESS [ 815.890093] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0ee9080c-8cce-48e3-86d7-285fa4431dd0 deletion is rescheduled due to dependency. [ 815.890197] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.045729] env[67094]: INFO networking_nsxv3.common.synchronization [req-0c99027e-c7c5-4167-a4c4-c13f91979909 req-cc21ed54-6efb-44a4-aadc-a4ee39aa9a4f tempest-ServerRescueTestJSONUnderV235-1264300176 tempest-ServerRescueTestJSONUnderV235-1264300176-project-member] Enqueued Resource ID: a685dbf9-8823-4364-9677-e8aff5bd2a59 with Priority: HIGHEST for action security_group_members [ 816.045924] env[67094]: INFO networking_nsxv3.common.synchronization [req-0c99027e-c7c5-4167-a4c4-c13f91979909 req-cc21ed54-6efb-44a4-aadc-a4ee39aa9a4f tempest-ServerRescueTestJSONUnderV235-1264300176 tempest-ServerRescueTestJSONUnderV235-1264300176-project-member] Enqueued Resource ID: a32cfdda-ac7b-4c6c-8c70-73287a5fa9f6 with Priority: HIGHEST for action security_group_members [ 816.046580] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a685dbf9-8823-4364-9677-e8aff5bd2a59 with Priority: HIGHEST for action security_group_members [ 816.046720] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a32cfdda-ac7b-4c6c-8c70-73287a5fa9f6 with Priority: HIGHEST for action security_group_members [ 816.047081] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-a685dbf9-8823-4364-9677-e8aff5bd2a59 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.047209] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.047402] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-a32cfdda-ac7b-4c6c-8c70-73287a5fa9f6 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.047501] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a32cfdda-ac7b-4c6c-8c70-73287a5fa9f6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.095480] env[67094]: INFO networking_nsxv3.common.synchronization [req-0c99027e-c7c5-4167-a4c4-c13f91979909 req-cc21ed54-6efb-44a4-aadc-a4ee39aa9a4f tempest-ServerRescueTestJSONUnderV235-1264300176 tempest-ServerRescueTestJSONUnderV235-1264300176-project-member] Enqueued Resource ID: a685dbf9-8823-4364-9677-e8aff5bd2a59 with Priority: HIGHEST for action security_group_rules [ 816.095663] env[67094]: INFO networking_nsxv3.common.synchronization [req-0c99027e-c7c5-4167-a4c4-c13f91979909 req-cc21ed54-6efb-44a4-aadc-a4ee39aa9a4f tempest-ServerRescueTestJSONUnderV235-1264300176 tempest-ServerRescueTestJSONUnderV235-1264300176-project-member] Enqueued Resource ID: a685dbf9-8823-4364-9677-e8aff5bd2a59 with Priority: HIGHEST for action security_group_members [ 816.095798] env[67094]: INFO networking_nsxv3.common.synchronization [req-0c99027e-c7c5-4167-a4c4-c13f91979909 req-cc21ed54-6efb-44a4-aadc-a4ee39aa9a4f tempest-ServerRescueTestJSONUnderV235-1264300176 tempest-ServerRescueTestJSONUnderV235-1264300176-project-member] Enqueued Resource ID: 07fc003d-db88-433f-85c3-0e029148a6c3 with Priority: HIGHEST for action port [ 816.096448] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a685dbf9-8823-4364-9677-e8aff5bd2a59 with Priority: HIGHEST for action security_group_rules [ 816.096755] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a685dbf9-8823-4364-9677-e8aff5bd2a59 with Priority: HIGHEST for action security_group_members [ 816.096864] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07fc003d-db88-433f-85c3-0e029148a6c3 with Priority: HIGHEST for action port [ 816.097226] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a685dbf9-8823-4364-9677-e8aff5bd2a59 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.097332] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.097614] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-a685dbf9-8823-4364-9677-e8aff5bd2a59 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.097669] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.097821] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-07fc003d-db88-433f-85c3-0e029148a6c3 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.097922] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-07fc003d-db88-433f-85c3-0e029148a6c3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.097983] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-07fc003d-db88-433f-85c3-0e029148a6c3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.098246] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-07fc003d-db88-433f-85c3-0e029148a6c3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.098328] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('07fc003d-db88-433f-85c3-0e029148a6c3',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.269861] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.270022] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.270093] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.270566] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.271422] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.271422] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0881101-1be1-4dbf-ac18-2d54a689202c is going to be updated. [ 816.323368] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.323368] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.323368] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.323368] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.323677] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.336864] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0881101-1be1-4dbf-ac18-2d54a689202c in Status: IN_PROGRESS for 2s [ 816.475788] env[67094]: INFO networking_nsxv3.common.synchronization [req-f5a7b864-c99f-48dc-9321-019130784eba req-e2805998-9a0c-4962-b452-2ed08f54d128 tempest-ServerDiskConfigTestJSON-51233165 tempest-ServerDiskConfigTestJSON-51233165-project-member] Enqueued Resource ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 with Priority: HIGHEST for action security_group_members [ 816.476716] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 with Priority: HIGHEST for action security_group_members [ 816.477335] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.477335] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.477500] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.477686] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.477887] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.478027] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.478102] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.478384] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.478558] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.478670] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.601859] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 07fc003d-db88-433f-85c3-0e029148a6c3 with status ACTIVE [ 816.601859] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.601859] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.601859] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.601859] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.601859] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.601859] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.601859] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.601859] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.601859] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.601859] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.602495] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.602495] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.602495] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.602495] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.602629] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.602629] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 07fc003d-db88-433f-85c3-0e029148a6c3 is going to be updated. [ 816.626199] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.626401] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.626724] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.626724] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.626870] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.626960] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-07fc003d-db88-433f-85c3-0e029148a6c3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.945555] env[67094]: INFO networking_nsxv3.common.synchronization [req-e4155e85-39b1-474b-bd3b-57448714c8e0 req-88a0058a-9728-43ec-a034-41b495bb9aa1 tempest-AttachInterfacesTestJSON-1117082489 tempest-AttachInterfacesTestJSON-1117082489-project-member] Enqueued Resource ID: eb77eddf-2e1d-485c-bfe8-67d4c174dc73 with Priority: HIGHEST for action security_group_members [ 816.946218] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: eb77eddf-2e1d-485c-bfe8-67d4c174dc73 with Priority: HIGHEST for action security_group_members [ 816.946566] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-eb77eddf-2e1d-485c-bfe8-67d4c174dc73 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.946691] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-eb77eddf-2e1d-485c-bfe8-67d4c174dc73" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.946737] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-eb77eddf-2e1d-485c-bfe8-67d4c174dc73" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.947033] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-eb77eddf-2e1d-485c-bfe8-67d4c174dc73" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.947291] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.947578] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.947578] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.947774] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 816.947876] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 816.948045] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('eb77eddf-2e1d-485c-bfe8-67d4c174dc73',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 816.981658] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 816.981836] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 816.981878] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 816.982093] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.011586] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.011586] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.011586] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.011586] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.012740] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.012740] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.012740] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 is going to be updated. [ 817.056757] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.056757] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.056757] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.056757] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.056757] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.064901] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 in Status: IN_PROGRESS for 2s [ 817.409555] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 2bc6c42e-23db-4008-8db7-e57d76593898 in Status: SUCCESS [ 817.409806] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2bc6c42e-23db-4008-8db7-e57d76593898" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.450572] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.450752] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.450792] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.452037] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.452037] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.452037] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.452037] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.452037] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.452037] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.452390] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.452390] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb77eddf-2e1d-485c-bfe8-67d4c174dc73 is going to be updated. [ 817.466757] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a685dbf9-8823-4364-9677-e8aff5bd2a59 in Status: SUCCESS [ 817.466757] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.466757] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.466757] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.467926] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.467926] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.467926] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.467926] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.467926] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.467926] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a685dbf9-8823-4364-9677-e8aff5bd2a59',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.471520] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a32cfdda-ac7b-4c6c-8c70-73287a5fa9f6 in Status: SUCCESS [ 817.471520] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a32cfdda-ac7b-4c6c-8c70-73287a5fa9f6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.471520] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a32cfdda-ac7b-4c6c-8c70-73287a5fa9f6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.471520] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a32cfdda-ac7b-4c6c-8c70-73287a5fa9f6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.471520] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.471520] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.471520] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.471520] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.471520] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.471520] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a32cfdda-ac7b-4c6c-8c70-73287a5fa9f6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.486272] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.486566] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.486566] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.486645] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.486802] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.497970] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb77eddf-2e1d-485c-bfe8-67d4c174dc73 in Status: IN_PROGRESS for 2s [ 817.837344] env[67094]: INFO networking_nsxv3.common.synchronization [req-f3dc943a-3054-46fa-aa63-93a0fa6719fc req-bce93219-03d5-44f4-8960-5b1537ccdd4d tempest-FloatingIPsAssociationTestJSON-2123953573 tempest-FloatingIPsAssociationTestJSON-2123953573-project-member] Enqueued Resource ID: 79476966-6948-4fb4-811c-c9f8cee63da2 with Priority: HIGHEST for action security_group_members [ 817.837344] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79476966-6948-4fb4-811c-c9f8cee63da2 with Priority: HIGHEST for action security_group_members [ 817.837344] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-79476966-6948-4fb4-811c-c9f8cee63da2 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.838020] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.838240] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.838569] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.838947] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.839200] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.839686] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.839686] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.839686] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.839890] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('79476966-6948-4fb4-811c-c9f8cee63da2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.972720] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a685dbf9-8823-4364-9677-e8aff5bd2a59',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 817.973778] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.973911] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.973984] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.974202] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.974293] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.974505] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 817.974605] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 817.974659] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 817.974786] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 817.974864] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 817.974949] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a32cfdda-ac7b-4c6c-8c70-73287a5fa9f6 is going to be deleted. [ 818.006828] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.006992] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.007131] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.007430] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.007570] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.007688] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a32cfdda-ac7b-4c6c-8c70-73287a5fa9f6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.007913] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a32cfdda-ac7b-4c6c-8c70-73287a5fa9f6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.009028] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a32cfdda-ac7b-4c6c-8c70-73287a5fa9f6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.009252] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.009365] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.009454] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.009781] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.009781] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.009781] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a32cfdda-ac7b-4c6c-8c70-73287a5fa9f6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.342301] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('79476966-6948-4fb4-811c-c9f8cee63da2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.352810] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0881101-1be1-4dbf-ac18-2d54a689202c in Status: SUCCESS [ 818.353135] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.478809] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a685dbf9-8823-4364-9677-e8aff5bd2a59',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.512327] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.512642] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.512642] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.512753] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.512834] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.513047] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.513211] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.513211] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.513359] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.513614] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.513614] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a32cfdda-ac7b-4c6c-8c70-73287a5fa9f6 already deleted. [ 818.513614] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a32cfdda-ac7b-4c6c-8c70-73287a5fa9f6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.513835] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a32cfdda-ac7b-4c6c-8c70-73287a5fa9f6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.514646] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a32cfdda-ac7b-4c6c-8c70-73287a5fa9f6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.514796] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a32cfdda-ac7b-4c6c-8c70-73287a5fa9f6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.514796] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.515404] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.515404] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.515545] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.515604] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.515703] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a32cfdda-ac7b-4c6c-8c70-73287a5fa9f6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.847848] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('79476966-6948-4fb4-811c-c9f8cee63da2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 818.987552] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 818.987552] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 818.987552] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 818.987552] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 818.987552] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 818.987552] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a685dbf9-8823-4364-9677-e8aff5bd2a59 is going to be updated. [ 819.017583] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a32cfdda-ac7b-4c6c-8c70-73287a5fa9f6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.019072] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.019072] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.019072] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.019072] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.019072] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.019398] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.019398] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.019398] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.019525] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.019624] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.019675] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a32cfdda-ac7b-4c6c-8c70-73287a5fa9f6 already deleted. [ 819.019733] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a32cfdda-ac7b-4c6c-8c70-73287a5fa9f6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.022161] env[67094]: INFO networking_nsxv3.common.synchronization [req-4cd3cbbe-7748-43dd-86a7-6a7c9c8c6bb9 req-ddbddca4-f6c2-4b73-900f-65b34b18c7a4 tempest-ServerActionsV293TestJSON-121023143 tempest-ServerActionsV293TestJSON-121023143-project-member] Enqueued Resource ID: 7ec28241-1cbc-4bfa-acfa-d9a84a1a6dae with Priority: HIGHEST for action security_group_members [ 819.025079] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.025342] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.025342] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.025546] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.026181] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.029037] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ec28241-1cbc-4bfa-acfa-d9a84a1a6dae with Priority: HIGHEST for action security_group_members [ 819.030645] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ec28241-1cbc-4bfa-acfa-d9a84a1a6dae taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.030783] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ec28241-1cbc-4bfa-acfa-d9a84a1a6dae" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.030831] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ec28241-1cbc-4bfa-acfa-d9a84a1a6dae" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.031141] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ec28241-1cbc-4bfa-acfa-d9a84a1a6dae" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.031391] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.032062] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.032062] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.032255] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.033432] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.033432] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ec28241-1cbc-4bfa-acfa-d9a84a1a6dae',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.044445] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a685dbf9-8823-4364-9677-e8aff5bd2a59 in Status: IN_PROGRESS for 2s [ 819.075948] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 in Status: SUCCESS [ 819.075948] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 deletion is rescheduled due to dependency. [ 819.075948] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.350934] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.351432] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.351432] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.352188] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.352188] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.352188] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 79476966-6948-4fb4-811c-c9f8cee63da2 is going to be updated. [ 819.384998] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.385222] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.385375] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.387836] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.387836] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.397180] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79476966-6948-4fb4-811c-c9f8cee63da2 in Status: IN_PROGRESS for 2s [ 819.514307] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: eb77eddf-2e1d-485c-bfe8-67d4c174dc73 in Status: SUCCESS [ 819.514586] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: eb77eddf-2e1d-485c-bfe8-67d4c174dc73 deletion is rescheduled due to dependency. [ 819.514586] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-eb77eddf-2e1d-485c-bfe8-67d4c174dc73" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.527584] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock network-527 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.527831] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "network-527" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.527950] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "network-527" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.528418] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "network-527" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.528715] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.528897] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.529030] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.529278] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.529420] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.529623] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 819.529727] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 819.529830] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 819.530066] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 819.530066] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 819.530218] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 819.530341] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 819.531987] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a32cfdda-ac7b-4c6c-8c70-73287a5fa9f6: rpc.has_security_group_logging(os_id): False [ 819.536964] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.537153] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.537231] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.537473] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.537935] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.537935] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.537935] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.537935] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.538719] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.538811] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.538904] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ec28241-1cbc-4bfa-acfa-d9a84a1a6dae already deleted. [ 819.539643] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ec28241-1cbc-4bfa-acfa-d9a84a1a6dae" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.551584] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.551983] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.551983] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.552192] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.552286] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.552500] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.553558] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.553558] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.553558] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.553558] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.553558] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a32cfdda-ac7b-4c6c-8c70-73287a5fa9f6 is going to be created. [ 819.558019] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 819.558019] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 819.558019] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 819.558019] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "network-527" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.558019] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock port-1730510f-29b3-4759-b0fe-c1b48dfc3af3 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.558019] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "port-1730510f-29b3-4759-b0fe-c1b48dfc3af3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.558019] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "port-1730510f-29b3-4759-b0fe-c1b48dfc3af3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.558019] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "port-1730510f-29b3-4759-b0fe-c1b48dfc3af3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.558019] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1730510f-29b3-4759-b0fe-c1b48dfc3af3',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 819.576314] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/a32cfdda-ac7b-4c6c-8c70-73287a5fa9f6], does not exist path=[/infra/domains/default/groups/a32cfdda-ac7b-4c6c-8c70-73287a5fa9f6]."\n}' [ 819.576404] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a32cfdda-ac7b-4c6c-8c70-73287a5fa9f6 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/a32cfdda-ac7b-4c6c-8c70-73287a5fa9f6 [ 819.576509] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 819.615884] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.616216] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.616281] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.616521] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.617876] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.618377] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.618500] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.618567] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.618752] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.618833] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.619059] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.619149] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.619215] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.619364] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.619454] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.619552] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a32cfdda-ac7b-4c6c-8c70-73287a5fa9f6 is going to be created. [ 819.638678] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/a32cfdda-ac7b-4c6c-8c70-73287a5fa9f6], does not exist path=[/infra/domains/default/groups/a32cfdda-ac7b-4c6c-8c70-73287a5fa9f6]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/a32cfdda-ac7b-4c6c-8c70-73287a5fa9f6 [ 819.638903] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a32cfdda-ac7b-4c6c-8c70-73287a5fa9f6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 819.639500] env[67094]: Traceback (most recent call last): [ 819.639644] env[67094]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 819.639644] env[67094]: return func(*args, **kwargs) [ 819.639644] env[67094]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 819.639644] env[67094]: res.raise_for_status() [ 819.639644] env[67094]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 819.639644] env[67094]: raise HTTPError(http_error_msg, response=self) [ 819.639644] env[67094]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/a32cfdda-ac7b-4c6c-8c70-73287a5fa9f6 [ 819.639644] env[67094]: During handling of the above exception, another exception occurred: [ 819.639644] env[67094]: Traceback (most recent call last): [ 819.639644] env[67094]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 819.639644] env[67094]: listener.cb(fileno) [ 819.639644] env[67094]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 819.639644] env[67094]: result = function(*args, **kwargs) [ 819.639644] env[67094]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 819.639644] env[67094]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 819.639644] env[67094]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 819.639644] env[67094]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 819.639644] env[67094]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 819.639644] env[67094]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 819.639644] env[67094]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 819.639644] env[67094]: res.raise_for_status() [ 819.639644] env[67094]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 819.639644] env[67094]: raise HTTPError(http_error_msg, response=self) [ 819.639644] env[67094]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/a32cfdda-ac7b-4c6c-8c70-73287a5fa9f6 [ 819.639644] env[67094]: Removing descriptor: 63 [ 819.973926] env[67094]: INFO networking_nsxv3.common.synchronization [None req-11a343ab-6a8b-4092-a2f1-6b5d9e86d2e2 tempest-ImagesOneServerNegativeTestJSON-1967011174 tempest-ImagesOneServerNegativeTestJSON-1967011174-project-member] Enqueued Resource ID: 43fe2f46-50e6-4e63-93b1-b9ac46722325 with Priority: HIGHEST for action security_group_rules [ 819.975053] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43fe2f46-50e6-4e63-93b1-b9ac46722325 with Priority: HIGHEST for action security_group_rules [ 819.975053] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-43fe2f46-50e6-4e63-93b1-b9ac46722325 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 819.975053] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-43fe2f46-50e6-4e63-93b1-b9ac46722325" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 819.975341] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-43fe2f46-50e6-4e63-93b1-b9ac46722325" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 819.975415] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-43fe2f46-50e6-4e63-93b1-b9ac46722325" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 819.975478] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('43fe2f46-50e6-4e63-93b1-b9ac46722325',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.059526] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.059765] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.059859] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.060148] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.060300] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.060462] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Segment Port 1730510f-29b3-4759-b0fe-c1b48dfc3af3 not found, creating... [ 820.060747] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.060903] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.061036] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.061276] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.061384] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.061658] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.061823] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.061935] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.062376] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.062542] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.062709] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Resource: SegmentPort with ID: 1730510f-29b3-4759-b0fe-c1b48dfc3af3 is going to be created. [ 820.085103] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.085372] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.085459] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.085722] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.085951] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.086451] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "port-1730510f-29b3-4759-b0fe-c1b48dfc3af3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.167156] env[67094]: INFO networking_nsxv3.common.synchronization [None req-d7709dbc-97d4-4697-b660-c4616ad1cec8 tempest-ImagesOneServerNegativeTestJSON-1967011174 tempest-ImagesOneServerNegativeTestJSON-1967011174-project-member] Enqueued Resource ID: 43fe2f46-50e6-4e63-93b1-b9ac46722325 with Priority: HIGHEST for action security_group_rules [ 820.167910] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43fe2f46-50e6-4e63-93b1-b9ac46722325 with Priority: HIGHEST for action security_group_rules [ 820.168207] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-43fe2f46-50e6-4e63-93b1-b9ac46722325 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.168338] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-43fe2f46-50e6-4e63-93b1-b9ac46722325" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.506197] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.506375] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.506478] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.506670] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.506785] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.506900] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 43fe2f46-50e6-4e63-93b1-b9ac46722325 already deleted. [ 820.507012] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-43fe2f46-50e6-4e63-93b1-b9ac46722325" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.507588] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-43fe2f46-50e6-4e63-93b1-b9ac46722325" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.507780] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-43fe2f46-50e6-4e63-93b1-b9ac46722325" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.507866] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('43fe2f46-50e6-4e63-93b1-b9ac46722325',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.784352] env[67094]: INFO networking_nsxv3.common.synchronization [req-4cd3cbbe-7748-43dd-86a7-6a7c9c8c6bb9 req-0dac6e17-2830-4eb1-8223-59e835788424 service nova] Enqueued Resource ID: 7ec28241-1cbc-4bfa-acfa-d9a84a1a6dae with Priority: HIGHEST for action security_group_rules [ 820.784670] env[67094]: INFO networking_nsxv3.common.synchronization [req-4cd3cbbe-7748-43dd-86a7-6a7c9c8c6bb9 req-0dac6e17-2830-4eb1-8223-59e835788424 service nova] Enqueued Resource ID: 7ec28241-1cbc-4bfa-acfa-d9a84a1a6dae with Priority: HIGHEST for action security_group_members [ 820.784928] env[67094]: INFO networking_nsxv3.common.synchronization [req-4cd3cbbe-7748-43dd-86a7-6a7c9c8c6bb9 req-0dac6e17-2830-4eb1-8223-59e835788424 service nova] Enqueued Resource ID: 1730510f-29b3-4759-b0fe-c1b48dfc3af3 with Priority: HIGHEST for action port [ 820.786176] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ec28241-1cbc-4bfa-acfa-d9a84a1a6dae with Priority: HIGHEST for action security_group_rules [ 820.786176] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ec28241-1cbc-4bfa-acfa-d9a84a1a6dae with Priority: HIGHEST for action security_group_members [ 820.786176] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1730510f-29b3-4759-b0fe-c1b48dfc3af3 with Priority: HIGHEST for action port [ 820.786461] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7ec28241-1cbc-4bfa-acfa-d9a84a1a6dae taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.786591] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7ec28241-1cbc-4bfa-acfa-d9a84a1a6dae" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.786659] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7ec28241-1cbc-4bfa-acfa-d9a84a1a6dae" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.786864] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7ec28241-1cbc-4bfa-acfa-d9a84a1a6dae" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.786947] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7ec28241-1cbc-4bfa-acfa-d9a84a1a6dae',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.787851] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ec28241-1cbc-4bfa-acfa-d9a84a1a6dae taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.788015] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ec28241-1cbc-4bfa-acfa-d9a84a1a6dae" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.788125] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ec28241-1cbc-4bfa-acfa-d9a84a1a6dae" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.788465] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ec28241-1cbc-4bfa-acfa-d9a84a1a6dae" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.788642] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.788750] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.788816] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.789740] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.789740] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 820.789740] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ec28241-1cbc-4bfa-acfa-d9a84a1a6dae',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 820.790429] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-1730510f-29b3-4759-b0fe-c1b48dfc3af3 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 820.790573] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1730510f-29b3-4759-b0fe-c1b48dfc3af3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 820.790643] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1730510f-29b3-4759-b0fe-c1b48dfc3af3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 820.790822] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1730510f-29b3-4759-b0fe-c1b48dfc3af3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 820.790922] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1730510f-29b3-4759-b0fe-c1b48dfc3af3',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.032365] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.032365] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.032365] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.032365] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.032365] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.032365] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 43fe2f46-50e6-4e63-93b1-b9ac46722325 already deleted. [ 821.032365] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-43fe2f46-50e6-4e63-93b1-b9ac46722325" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.059261] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a685dbf9-8823-4364-9677-e8aff5bd2a59 in Status: SUCCESS [ 821.059261] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.059261] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.059261] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.059261] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.059261] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.059261] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.059261] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.059261] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.059261] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.063520] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a685dbf9-8823-4364-9677-e8aff5bd2a59',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.063520] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.063520] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.063520] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.063520] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.063520] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.063520] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.063520] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.063520] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a685dbf9-8823-4364-9677-e8aff5bd2a59',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.299650] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ec28241-1cbc-4bfa-acfa-d9a84a1a6dae taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.299856] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ec28241-1cbc-4bfa-acfa-d9a84a1a6dae" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.300048] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7ec28241-1cbc-4bfa-acfa-d9a84a1a6dae',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.301080] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1730510f-29b3-4759-b0fe-c1b48dfc3af3 with status ACTIVE [ 821.301667] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.301667] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.301667] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.302308] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.302422] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.305117] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.305117] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.305117] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.305117] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.305117] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.305117] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.305117] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.305775] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.306029] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.306029] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.306253] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1730510f-29b3-4759-b0fe-c1b48dfc3af3 is going to be updated. [ 821.339752] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.339937] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.340017] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.340365] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.340641] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.340898] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1730510f-29b3-4759-b0fe-c1b48dfc3af3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.413552] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79476966-6948-4fb4-811c-c9f8cee63da2 in Status: SUCCESS [ 821.413552] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.568103] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a685dbf9-8823-4364-9677-e8aff5bd2a59',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.568103] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-a685dbf9-8823-4364-9677-e8aff5bd2a59 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.568103] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.812869] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7ec28241-1cbc-4bfa-acfa-d9a84a1a6dae',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.857179] env[67094]: INFO networking_nsxv3.common.synchronization [req-7e343cca-39c5-41b8-b88a-8a59663c0531 req-7b8ff218-648e-4b5b-959c-d95d3778a09d tempest-ServerActionsTestOtherA-276518123 tempest-ServerActionsTestOtherA-276518123-project-member] Enqueued Resource ID: 005d1062-21f3-48fc-b7a0-06c9f0fc7843 with Priority: HIGHEST for action security_group_members [ 821.858696] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 005d1062-21f3-48fc-b7a0-06c9f0fc7843 with Priority: HIGHEST for action security_group_members [ 821.858696] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-005d1062-21f3-48fc-b7a0-06c9f0fc7843 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.858696] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-005d1062-21f3-48fc-b7a0-06c9f0fc7843" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.858696] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-005d1062-21f3-48fc-b7a0-06c9f0fc7843" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.858696] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-005d1062-21f3-48fc-b7a0-06c9f0fc7843" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.858981] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.858981] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.858981] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.859156] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.859259] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 821.859374] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('005d1062-21f3-48fc-b7a0-06c9f0fc7843',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 821.875163] env[67094]: INFO networking_nsxv3.common.synchronization [req-4e419f78-8e29-43ed-9498-a2c53b674d26 req-d24ee186-5575-48e3-9fa5-495ad593545c tempest-SecurityGroupRulesTestJSON-2088080837 tempest-SecurityGroupRulesTestJSON-2088080837-project-member] Enqueued Resource ID: 51068849-2175-4c02-aa56-42ef3b8aa1a6 with Priority: HIGHEST for action security_group_rules [ 821.875163] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51068849-2175-4c02-aa56-42ef3b8aa1a6 with Priority: HIGHEST for action security_group_rules [ 821.875163] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-51068849-2175-4c02-aa56-42ef3b8aa1a6 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 821.875163] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-51068849-2175-4c02-aa56-42ef3b8aa1a6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 821.875163] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-51068849-2175-4c02-aa56-42ef3b8aa1a6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 821.875391] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-51068849-2175-4c02-aa56-42ef3b8aa1a6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 821.875391] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('51068849-2175-4c02-aa56-42ef3b8aa1a6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.068599] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a685dbf9-8823-4364-9677-e8aff5bd2a59',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.256645] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock network-997 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.256905] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "network-997" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.256984] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "network-997" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.257351] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "network-997" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.257620] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.257778] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.257918] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.258171] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.258372] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.258613] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 822.258726] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 822.258841] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 822.258947] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 822.259086] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 822.259187] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 822.259334] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 822.280851] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 822.280851] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 822.280851] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 822.280851] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "network-997" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.280851] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock port-f17d106c-f58f-48ea-80fb-86958f8440f3 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.280851] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "port-f17d106c-f58f-48ea-80fb-86958f8440f3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.280851] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "port-f17d106c-f58f-48ea-80fb-86958f8440f3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.281236] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "port-f17d106c-f58f-48ea-80fb-86958f8440f3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.281236] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f17d106c-f58f-48ea-80fb-86958f8440f3',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 822.315358] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.315613] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.315735] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.315952] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.316079] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.316246] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ec28241-1cbc-4bfa-acfa-d9a84a1a6dae is going to be created. [ 822.342053] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.342281] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.342348] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.343587] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.343587] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.354609] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ec28241-1cbc-4bfa-acfa-d9a84a1a6dae in Status: UNINITIALIZED for 2s [ 822.362232] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.362446] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.362446] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.362674] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.362765] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.362962] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.363080] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.363139] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.363293] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.363369] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.363452] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 005d1062-21f3-48fc-b7a0-06c9f0fc7843 already deleted. [ 822.363532] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-005d1062-21f3-48fc-b7a0-06c9f0fc7843" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.403199] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.403199] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.403199] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.403199] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.403199] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.403199] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 51068849-2175-4c02-aa56-42ef3b8aa1a6 already deleted. [ 822.403199] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-51068849-2175-4c02-aa56-42ef3b8aa1a6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.570879] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.571069] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.571119] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.571324] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.571415] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.571514] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a685dbf9-8823-4364-9677-e8aff5bd2a59 is going to be updated. [ 822.603134] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.603330] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.603401] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.605722] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.605722] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.612650] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a685dbf9-8823-4364-9677-e8aff5bd2a59 in Status: IN_PROGRESS for 2s [ 822.785511] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.785665] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.785794] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.786094] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.786330] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.786507] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Segment Port f17d106c-f58f-48ea-80fb-86958f8440f3 not found, creating... [ 822.786811] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.786971] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.787098] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.787316] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.787451] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.787727] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.787890] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.788021] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.788293] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.788430] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.788568] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Resource: SegmentPort with ID: f17d106c-f58f-48ea-80fb-86958f8440f3 is going to be created. [ 822.811019] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 822.811282] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 822.811445] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 822.811768] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 822.812017] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 822.812270] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "port-f17d106c-f58f-48ea-80fb-86958f8440f3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.576777] env[67094]: INFO networking_nsxv3.common.synchronization [req-7e343cca-39c5-41b8-b88a-8a59663c0531 req-0863ed5d-bcfe-437b-b892-58e810e961b9 service nova] Enqueued Resource ID: 005d1062-21f3-48fc-b7a0-06c9f0fc7843 with Priority: HIGHEST for action security_group_rules [ 823.577083] env[67094]: INFO networking_nsxv3.common.synchronization [req-7e343cca-39c5-41b8-b88a-8a59663c0531 req-0863ed5d-bcfe-437b-b892-58e810e961b9 service nova] Enqueued Resource ID: 005d1062-21f3-48fc-b7a0-06c9f0fc7843 with Priority: HIGHEST for action security_group_members [ 823.577331] env[67094]: INFO networking_nsxv3.common.synchronization [req-7e343cca-39c5-41b8-b88a-8a59663c0531 req-0863ed5d-bcfe-437b-b892-58e810e961b9 service nova] Enqueued Resource ID: f17d106c-f58f-48ea-80fb-86958f8440f3 with Priority: HIGHEST for action port [ 823.577838] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 005d1062-21f3-48fc-b7a0-06c9f0fc7843 with Priority: HIGHEST for action security_group_rules [ 823.578293] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 005d1062-21f3-48fc-b7a0-06c9f0fc7843 with Priority: HIGHEST for action security_group_members [ 823.578293] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f17d106c-f58f-48ea-80fb-86958f8440f3 with Priority: HIGHEST for action port [ 823.578489] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-005d1062-21f3-48fc-b7a0-06c9f0fc7843 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.578609] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-005d1062-21f3-48fc-b7a0-06c9f0fc7843" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.578674] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-005d1062-21f3-48fc-b7a0-06c9f0fc7843" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.578906] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-005d1062-21f3-48fc-b7a0-06c9f0fc7843" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.578988] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('005d1062-21f3-48fc-b7a0-06c9f0fc7843',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.580735] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-005d1062-21f3-48fc-b7a0-06c9f0fc7843 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.580735] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-005d1062-21f3-48fc-b7a0-06c9f0fc7843" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.580735] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-005d1062-21f3-48fc-b7a0-06c9f0fc7843" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.581018] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-005d1062-21f3-48fc-b7a0-06c9f0fc7843" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.581673] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.581763] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.581837] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.582423] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.582423] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 823.582423] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('005d1062-21f3-48fc-b7a0-06c9f0fc7843',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 823.583412] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-f17d106c-f58f-48ea-80fb-86958f8440f3 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 823.583412] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f17d106c-f58f-48ea-80fb-86958f8440f3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 823.583412] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f17d106c-f58f-48ea-80fb-86958f8440f3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 823.584190] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f17d106c-f58f-48ea-80fb-86958f8440f3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 823.584190] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f17d106c-f58f-48ea-80fb-86958f8440f3',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.085890] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-005d1062-21f3-48fc-b7a0-06c9f0fc7843 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.086215] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-005d1062-21f3-48fc-b7a0-06c9f0fc7843" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.086492] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('005d1062-21f3-48fc-b7a0-06c9f0fc7843',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.087539] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port f17d106c-f58f-48ea-80fb-86958f8440f3 with status ACTIVE [ 824.087868] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.088039] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.088142] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.088909] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.089242] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.091328] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.091328] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.091328] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.091328] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.091328] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.091328] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.091328] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.091328] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.091659] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.091659] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.091659] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: f17d106c-f58f-48ea-80fb-86958f8440f3 is going to be updated. [ 824.118708] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.118909] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.118952] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.119382] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.119479] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.119920] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f17d106c-f58f-48ea-80fb-86958f8440f3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.125694] env[67094]: INFO networking_nsxv3.common.synchronization [req-8792fcbb-25d4-48c0-87ad-e728c906a8ac req-330c16e6-ac7d-4f3d-887c-77c057e25039 tempest-SecurityGroupRulesTestJSON-2088080837 tempest-SecurityGroupRulesTestJSON-2088080837-project-member] Enqueued Resource ID: 51068849-2175-4c02-aa56-42ef3b8aa1a6 with Priority: HIGHEST for action security_group_rules [ 824.125875] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51068849-2175-4c02-aa56-42ef3b8aa1a6 with Priority: HIGHEST for action security_group_rules [ 824.126320] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-51068849-2175-4c02-aa56-42ef3b8aa1a6 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.126441] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-51068849-2175-4c02-aa56-42ef3b8aa1a6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.126441] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-51068849-2175-4c02-aa56-42ef3b8aa1a6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.126629] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-51068849-2175-4c02-aa56-42ef3b8aa1a6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.126728] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('51068849-2175-4c02-aa56-42ef3b8aa1a6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.366338] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ec28241-1cbc-4bfa-acfa-d9a84a1a6dae in Status: SUCCESS [ 824.366593] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ec28241-1cbc-4bfa-acfa-d9a84a1a6dae" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.366773] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ec28241-1cbc-4bfa-acfa-d9a84a1a6dae" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.366988] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ec28241-1cbc-4bfa-acfa-d9a84a1a6dae" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.367221] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.367349] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.367434] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.367578] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.368170] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.368170] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ec28241-1cbc-4bfa-acfa-d9a84a1a6dae" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.368170] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7ec28241-1cbc-4bfa-acfa-d9a84a1a6dae',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.594350] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('005d1062-21f3-48fc-b7a0-06c9f0fc7843',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.624009] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a685dbf9-8823-4364-9677-e8aff5bd2a59 in Status: SUCCESS [ 824.625589] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.625589] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.625589] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.625589] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.625589] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.625589] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.625589] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.625589] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.625589] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a685dbf9-8823-4364-9677-e8aff5bd2a59',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 824.646999] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 824.647155] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 824.647234] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 824.647449] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 824.647539] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.647632] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 51068849-2175-4c02-aa56-42ef3b8aa1a6 already deleted. [ 824.647711] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-51068849-2175-4c02-aa56-42ef3b8aa1a6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 824.871265] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7ec28241-1cbc-4bfa-acfa-d9a84a1a6dae',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.101456] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.104019] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.104019] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.104019] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.104019] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.104019] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 005d1062-21f3-48fc-b7a0-06c9f0fc7843 is going to be created. [ 825.112023] env[67094]: INFO networking_nsxv3.common.synchronization [req-831f378d-1049-4336-92a9-474954ef3fb1 req-a6c5162f-4450-4f7c-b44b-8555cef605e7 tempest-VolumesAdminNegativeTest-1228606920 tempest-VolumesAdminNegativeTest-1228606920-project-member] Enqueued Resource ID: 087ace1a-6d14-459c-b6b4-b5fb31f2020d with Priority: HIGHEST for action security_group_members [ 825.112023] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 087ace1a-6d14-459c-b6b4-b5fb31f2020d with Priority: HIGHEST for action security_group_members [ 825.112023] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-087ace1a-6d14-459c-b6b4-b5fb31f2020d taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.112023] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-087ace1a-6d14-459c-b6b4-b5fb31f2020d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.112023] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-087ace1a-6d14-459c-b6b4-b5fb31f2020d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.112023] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-087ace1a-6d14-459c-b6b4-b5fb31f2020d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.112023] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.113379] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.118188] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.118509] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.118613] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.118747] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('087ace1a-6d14-459c-b6b4-b5fb31f2020d',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.127829] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a685dbf9-8823-4364-9677-e8aff5bd2a59',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.142374] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.142374] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.142374] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.142374] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.142374] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.154996] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 005d1062-21f3-48fc-b7a0-06c9f0fc7843 in Status: UNINITIALIZED for 2s [ 825.375962] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7ec28241-1cbc-4bfa-acfa-d9a84a1a6dae: rpc.has_security_group_logging(os_id): False [ 825.401194] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.401463] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.401615] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.401959] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.402154] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.402572] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.402728] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.402828] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.403126] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.403256] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.403401] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7ec28241-1cbc-4bfa-acfa-d9a84a1a6dae is going to be created. [ 825.504180] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.505496] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.505496] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.505496] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.505871] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.525754] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ec28241-1cbc-4bfa-acfa-d9a84a1a6dae in Status: IN_PROGRESS for 2s [ 825.624343] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.624343] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.624343] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.624343] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.630597] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a685dbf9-8823-4364-9677-e8aff5bd2a59',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 825.661659] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.662042] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.662113] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.662205] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.662539] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.662539] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.662606] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 087ace1a-6d14-459c-b6b4-b5fb31f2020d is going to be updated. [ 825.706476] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 825.706660] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 825.706724] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 825.706925] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 825.707082] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 825.716666] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 087ace1a-6d14-459c-b6b4-b5fb31f2020d in Status: IN_PROGRESS for 2s [ 826.133715] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.133985] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.134088] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.134352] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.134449] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.134601] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a685dbf9-8823-4364-9677-e8aff5bd2a59 is going to be updated. [ 826.176930] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 826.177189] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 826.177291] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 826.177559] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 826.177706] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 826.188687] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a685dbf9-8823-4364-9677-e8aff5bd2a59 in Status: IN_PROGRESS for 2s [ 827.170648] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 005d1062-21f3-48fc-b7a0-06c9f0fc7843 in Status: SUCCESS [ 827.170648] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-005d1062-21f3-48fc-b7a0-06c9f0fc7843" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.170648] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-005d1062-21f3-48fc-b7a0-06c9f0fc7843" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.170648] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-005d1062-21f3-48fc-b7a0-06c9f0fc7843" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.170648] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.170648] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.170648] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.170648] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.170648] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.170648] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-005d1062-21f3-48fc-b7a0-06c9f0fc7843" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.170648] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('005d1062-21f3-48fc-b7a0-06c9f0fc7843',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.395249] env[67094]: INFO networking_nsxv3.common.synchronization [req-d0ae3759-cc90-4a2f-b48e-862433e711d0 req-191daa83-16ca-42e9-8163-1f5a9e356898 tempest-SecurityGroupRulesTestJSON-2088080837 tempest-SecurityGroupRulesTestJSON-2088080837-project-member] Enqueued Resource ID: 51068849-2175-4c02-aa56-42ef3b8aa1a6 with Priority: HIGHEST for action security_group_rules [ 827.395638] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 51068849-2175-4c02-aa56-42ef3b8aa1a6 with Priority: HIGHEST for action security_group_rules [ 827.396341] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-51068849-2175-4c02-aa56-42ef3b8aa1a6 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.396341] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-51068849-2175-4c02-aa56-42ef3b8aa1a6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.396507] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-51068849-2175-4c02-aa56-42ef3b8aa1a6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.396698] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-51068849-2175-4c02-aa56-42ef3b8aa1a6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.396698] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('51068849-2175-4c02-aa56-42ef3b8aa1a6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.543904] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7ec28241-1cbc-4bfa-acfa-d9a84a1a6dae in Status: SUCCESS [ 827.544246] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7ec28241-1cbc-4bfa-acfa-d9a84a1a6dae" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.675070] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('005d1062-21f3-48fc-b7a0-06c9f0fc7843',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 827.727302] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 087ace1a-6d14-459c-b6b4-b5fb31f2020d in Status: SUCCESS [ 827.727590] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 087ace1a-6d14-459c-b6b4-b5fb31f2020d deletion is rescheduled due to dependency. [ 827.727764] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-087ace1a-6d14-459c-b6b4-b5fb31f2020d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.924037] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 827.924037] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 827.924037] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 827.924037] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 827.924388] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 827.924388] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 51068849-2175-4c02-aa56-42ef3b8aa1a6 already deleted. [ 827.924388] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-51068849-2175-4c02-aa56-42ef3b8aa1a6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.178607] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 005d1062-21f3-48fc-b7a0-06c9f0fc7843: rpc.has_security_group_logging(os_id): False [ 828.203021] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.203021] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.203021] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.203021] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.203021] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.203021] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.203021] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.203021] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.203021] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.203021] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.203021] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 005d1062-21f3-48fc-b7a0-06c9f0fc7843 is going to be created. [ 828.205501] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a685dbf9-8823-4364-9677-e8aff5bd2a59 in Status: SUCCESS [ 828.206248] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.206980] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.208019] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.208019] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.208019] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.208019] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.208019] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.208019] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.208544] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.208839] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-a685dbf9-8823-4364-9677-e8aff5bd2a59 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.209098] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.210877] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.210877] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.210877] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.210877] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.210877] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.210877] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.210877] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.210877] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.210877] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a685dbf9-8823-4364-9677-e8aff5bd2a59',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 828.267035] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.267035] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.267035] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.267533] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.267533] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.284286] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 005d1062-21f3-48fc-b7a0-06c9f0fc7843 in Status: IN_PROGRESS for 2s [ 828.712645] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a685dbf9-8823-4364-9677-e8aff5bd2a59: rpc.has_security_group_logging(os_id): False [ 828.738725] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.738895] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.738943] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.739169] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.760023] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.760304] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.760470] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.760539] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.760882] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.760946] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.761224] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.761344] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.761411] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.761593] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.761684] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.761871] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.761967] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.762124] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.762280] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.762384] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.762480] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a685dbf9-8823-4364-9677-e8aff5bd2a59 is going to be updated. [ 828.828993] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 828.828993] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 828.829185] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 828.829344] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 828.829568] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 828.846045] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a685dbf9-8823-4364-9677-e8aff5bd2a59 in Status: IN_PROGRESS for 2s [ 830.302938] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 005d1062-21f3-48fc-b7a0-06c9f0fc7843 in Status: SUCCESS [ 830.303373] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-005d1062-21f3-48fc-b7a0-06c9f0fc7843" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.870036] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a685dbf9-8823-4364-9677-e8aff5bd2a59 in Status: SUCCESS [ 830.870286] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 830.870571] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 830.870885] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 830.870995] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a685dbf9-8823-4364-9677-e8aff5bd2a59',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.373274] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-a685dbf9-8823-4364-9677-e8aff5bd2a59 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.373634] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.373634] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.373722] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.374580] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.374580] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.374580] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.374580] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.374580] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.374580] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.374580] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a685dbf9-8823-4364-9677-e8aff5bd2a59',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.618603] env[67094]: INFO networking_nsxv3.common.synchronization [None req-96e7726e-e8c0-458e-a646-529b4e7eabd8 None None] Enqueued Resource ID: 29ddf605-8b0e-4761-99e6-b1a3591e8c23 with Priority: HIGHEST for action port [ 831.622025] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 29ddf605-8b0e-4761-99e6-b1a3591e8c23 with Priority: HIGHEST for action port [ 831.622025] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-29ddf605-8b0e-4761-99e6-b1a3591e8c23 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.622025] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-29ddf605-8b0e-4761-99e6-b1a3591e8c23" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.622025] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-29ddf605-8b0e-4761-99e6-b1a3591e8c23" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.622025] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-29ddf605-8b0e-4761-99e6-b1a3591e8c23" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.622529] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('29ddf605-8b0e-4761-99e6-b1a3591e8c23',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 831.880116] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-a685dbf9-8823-4364-9677-e8aff5bd2a59 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.880116] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.880116] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.880116] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.880116] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.880116] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.880116] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.880116] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.880116] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.880116] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.880116] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-a685dbf9-8823-4364-9677-e8aff5bd2a59 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.880116] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.880116] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.880116] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.880116] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 831.880116] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 831.880698] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 831.880698] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 831.880698] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.880698] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 831.880698] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a685dbf9-8823-4364-9677-e8aff5bd2a59',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 832.125382] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 29ddf605-8b0e-4761-99e6-b1a3591e8c23 [ 832.125623] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.125762] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.125831] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.126144] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.126225] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.126406] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:29ddf605-8b0e-4761-99e6-b1a3591e8c23 already deleted. [ 832.126471] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-29ddf605-8b0e-4761-99e6-b1a3591e8c23" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.382434] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a685dbf9-8823-4364-9677-e8aff5bd2a59: rpc.has_security_group_logging(os_id): False [ 832.404758] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.404758] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.404758] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.404758] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.404758] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.404758] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.404758] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.404758] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.404758] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.404758] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.404758] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.404758] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.404758] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.405470] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.405470] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.405470] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.405470] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.405470] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.405789] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.405936] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.406035] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a685dbf9-8823-4364-9677-e8aff5bd2a59 is going to be updated. [ 832.468675] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 832.468675] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 832.468675] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 832.468883] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 832.468883] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 832.486433] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a685dbf9-8823-4364-9677-e8aff5bd2a59 in Status: IN_PROGRESS for 2s [ 834.110042] env[67094]: INFO networking_nsxv3.common.synchronization [None req-b3741786-d7c4-46fb-955a-cb05ae7fce8a None None] Enqueued Resource ID: ce81f9f3-e2d6-4af7-8d86-07885e718637 with Priority: HIGHEST for action port [ 834.110802] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce81f9f3-e2d6-4af7-8d86-07885e718637 with Priority: HIGHEST for action port [ 834.110973] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-ce81f9f3-e2d6-4af7-8d86-07885e718637 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.111170] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ce81f9f3-e2d6-4af7-8d86-07885e718637" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.111170] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ce81f9f3-e2d6-4af7-8d86-07885e718637" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.111412] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ce81f9f3-e2d6-4af7-8d86-07885e718637" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.111514] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce81f9f3-e2d6-4af7-8d86-07885e718637',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 834.504999] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a685dbf9-8823-4364-9677-e8aff5bd2a59 in Status: SUCCESS [ 834.505359] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.617154] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ce81f9f3-e2d6-4af7-8d86-07885e718637 [ 834.618305] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 834.618305] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 834.618305] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 834.618305] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 834.618305] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 834.618305] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ce81f9f3-e2d6-4af7-8d86-07885e718637 already deleted. [ 834.618305] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ce81f9f3-e2d6-4af7-8d86-07885e718637" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.172928] env[67094]: INFO networking_nsxv3.common.synchronization [req-9a9a9064-76c6-40ac-b5da-f13d559d69cb req-ac2fe0fe-755e-4771-9550-6540d283613f tempest-ServerRescueTestJSONUnderV235-1264300176 tempest-ServerRescueTestJSONUnderV235-1264300176-project-member] Enqueued Resource ID: a685dbf9-8823-4364-9677-e8aff5bd2a59 with Priority: HIGHEST for action security_group_members [ 836.174095] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a685dbf9-8823-4364-9677-e8aff5bd2a59 with Priority: HIGHEST for action security_group_members [ 836.174095] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-a685dbf9-8823-4364-9677-e8aff5bd2a59 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.174095] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.174095] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.174273] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.174309] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.174558] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.174558] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.174656] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.174656] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.174757] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a685dbf9-8823-4364-9677-e8aff5bd2a59',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 836.680950] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.680950] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.681112] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.681261] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.681342] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.681539] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.681630] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.682409] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.682409] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.682409] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.682409] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a685dbf9-8823-4364-9677-e8aff5bd2a59 is going to be updated. [ 836.716680] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 836.716680] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 836.716680] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 836.716890] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 836.716931] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 836.727677] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a685dbf9-8823-4364-9677-e8aff5bd2a59 in Status: IN_PROGRESS for 2s [ 838.495296] env[67094]: INFO networking_nsxv3.common.synchronization [req-3adc1d4d-7822-4956-9717-76f976524fff req-c3ec5163-be47-496b-903b-6086ec4020ab tempest-ServerPasswordTestJSON-208858571 tempest-ServerPasswordTestJSON-208858571-project-member] Enqueued Resource ID: 1c0d7199-02e7-494e-9784-a23947a72cd2 with Priority: HIGHEST for action security_group_members [ 838.495683] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c0d7199-02e7-494e-9784-a23947a72cd2 with Priority: HIGHEST for action security_group_members [ 838.495988] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c0d7199-02e7-494e-9784-a23947a72cd2 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.496357] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c0d7199-02e7-494e-9784-a23947a72cd2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.496436] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c0d7199-02e7-494e-9784-a23947a72cd2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.496695] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c0d7199-02e7-494e-9784-a23947a72cd2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.496876] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 838.497073] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 838.497451] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 838.497451] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 838.497554] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.497624] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c0d7199-02e7-494e-9784-a23947a72cd2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 838.738933] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a685dbf9-8823-4364-9677-e8aff5bd2a59 in Status: SUCCESS [ 838.739232] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a685dbf9-8823-4364-9677-e8aff5bd2a59 deletion is rescheduled due to dependency. [ 838.739431] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 838.999937] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.000124] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.000200] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.000836] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.001028] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.001295] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.001431] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.001518] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.001684] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.001766] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.002092] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c0d7199-02e7-494e-9784-a23947a72cd2 already deleted. [ 839.002092] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c0d7199-02e7-494e-9784-a23947a72cd2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.089626] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock network-619 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.089814] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "network-619" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.089936] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "network-619" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.090276] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "network-619" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.090539] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.090748] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.090832] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.091062] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.091205] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.091426] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 839.091516] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 839.091632] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 839.091706] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 839.091809] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 839.091912] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 839.092477] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 839.112253] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 839.112412] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 839.112510] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 839.112692] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "network-619" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.113025] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock port-fa1d2feb-fe14-46ae-8c6e-6ab09911c085 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.113224] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "port-fa1d2feb-fe14-46ae-8c6e-6ab09911c085" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.113314] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "port-fa1d2feb-fe14-46ae-8c6e-6ab09911c085" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.113637] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "port-fa1d2feb-fe14-46ae-8c6e-6ab09911c085" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.113772] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa1d2feb-fe14-46ae-8c6e-6ab09911c085',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 839.615891] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.616415] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.616522] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.616865] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.617121] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.617356] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Segment Port fa1d2feb-fe14-46ae-8c6e-6ab09911c085 not found, creating... [ 839.617771] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.618088] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.618277] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.618690] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.618947] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.619431] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.619714] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.619908] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.620232] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.620466] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.620695] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Resource: SegmentPort with ID: fa1d2feb-fe14-46ae-8c6e-6ab09911c085 is going to be created. [ 839.644833] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 839.645134] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 839.645285] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 839.645568] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 839.645828] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 839.646089] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "port-fa1d2feb-fe14-46ae-8c6e-6ab09911c085" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.413439] env[67094]: INFO networking_nsxv3.common.synchronization [req-3adc1d4d-7822-4956-9717-76f976524fff req-d11681ac-c103-4b80-b40a-f2274ec3ceac service nova] Enqueued Resource ID: 1c0d7199-02e7-494e-9784-a23947a72cd2 with Priority: HIGHEST for action security_group_rules [ 840.413637] env[67094]: INFO networking_nsxv3.common.synchronization [req-3adc1d4d-7822-4956-9717-76f976524fff req-d11681ac-c103-4b80-b40a-f2274ec3ceac service nova] Enqueued Resource ID: 1c0d7199-02e7-494e-9784-a23947a72cd2 with Priority: HIGHEST for action security_group_members [ 840.413774] env[67094]: INFO networking_nsxv3.common.synchronization [req-3adc1d4d-7822-4956-9717-76f976524fff req-d11681ac-c103-4b80-b40a-f2274ec3ceac service nova] Enqueued Resource ID: fa1d2feb-fe14-46ae-8c6e-6ab09911c085 with Priority: HIGHEST for action port [ 840.414368] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c0d7199-02e7-494e-9784-a23947a72cd2 with Priority: HIGHEST for action security_group_rules [ 840.414540] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c0d7199-02e7-494e-9784-a23947a72cd2 with Priority: HIGHEST for action security_group_members [ 840.414651] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa1d2feb-fe14-46ae-8c6e-6ab09911c085 with Priority: HIGHEST for action port [ 840.415264] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1c0d7199-02e7-494e-9784-a23947a72cd2 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.415264] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1c0d7199-02e7-494e-9784-a23947a72cd2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.415264] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1c0d7199-02e7-494e-9784-a23947a72cd2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.415659] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1c0d7199-02e7-494e-9784-a23947a72cd2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.415743] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1c0d7199-02e7-494e-9784-a23947a72cd2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.416867] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c0d7199-02e7-494e-9784-a23947a72cd2 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.417647] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c0d7199-02e7-494e-9784-a23947a72cd2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.417647] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c0d7199-02e7-494e-9784-a23947a72cd2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.417647] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c0d7199-02e7-494e-9784-a23947a72cd2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.417647] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.417647] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.417647] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.418246] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.418246] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.418246] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c0d7199-02e7-494e-9784-a23947a72cd2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.420368] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-fa1d2feb-fe14-46ae-8c6e-6ab09911c085 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.420368] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fa1d2feb-fe14-46ae-8c6e-6ab09911c085" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.420368] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fa1d2feb-fe14-46ae-8c6e-6ab09911c085" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.420368] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fa1d2feb-fe14-46ae-8c6e-6ab09911c085" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.420368] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fa1d2feb-fe14-46ae-8c6e-6ab09911c085',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.923678] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fa1d2feb-fe14-46ae-8c6e-6ab09911c085 with status ACTIVE [ 840.923985] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.924089] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.924162] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.924345] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.924458] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.924614] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.924715] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.924774] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.924930] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.925014] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.925200] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.925294] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.925353] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.925490] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.925566] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.925650] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fa1d2feb-fe14-46ae-8c6e-6ab09911c085 is going to be updated. [ 840.927584] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1c0d7199-02e7-494e-9784-a23947a72cd2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 840.928872] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c0d7199-02e7-494e-9784-a23947a72cd2 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.928974] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c0d7199-02e7-494e-9784-a23947a72cd2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.950712] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 840.950712] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 840.950712] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 840.950712] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 840.951166] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 840.951166] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fa1d2feb-fe14-46ae-8c6e-6ab09911c085" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.430057] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1c0d7199-02e7-494e-9784-a23947a72cd2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.451182] env[67094]: INFO networking_nsxv3.common.synchronization [req-e1de0449-624a-4a33-b5ae-04871919bc7f req-b10e9345-e2b4-4304-bef7-8c7817a06e90 tempest-ServerActionsTestOtherB-1168296312 tempest-ServerActionsTestOtherB-1168296312-project-member] Enqueued Resource ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 with Priority: HIGHEST for action security_group_members [ 841.451690] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 with Priority: HIGHEST for action security_group_members [ 841.451980] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.452687] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.452687] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.452832] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.452988] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.453374] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.453374] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.453374] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.453514] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.453514] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.816185] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock network-78 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.816185] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "network-78" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.816185] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "network-78" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.816511] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "network-78" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.816921] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.817177] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.817364] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.817701] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.817922] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.818975] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 841.818975] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 841.818975] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 841.819209] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 841.819323] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 841.819506] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 841.819776] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 841.843912] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 841.844104] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 841.844245] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 841.844529] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "network-78" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.844911] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock port-b60a60a0-0679-41dc-958c-4a0cb666037c taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.845107] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "port-b60a60a0-0679-41dc-958c-4a0cb666037c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.845227] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "port-b60a60a0-0679-41dc-958c-4a0cb666037c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.845561] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "port-b60a60a0-0679-41dc-958c-4a0cb666037c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.846063] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b60a60a0-0679-41dc-958c-4a0cb666037c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 841.932787] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.936546] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.936546] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.936546] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.936546] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.936546] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c0d7199-02e7-494e-9784-a23947a72cd2 is going to be created. [ 841.959168] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.959168] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.959168] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.959445] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.959604] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.959866] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.959979] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.960045] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.960206] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.961029] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.961029] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 already deleted. [ 841.961029] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.965944] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 841.965944] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 841.966258] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 841.966486] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 841.967025] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 841.977849] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c0d7199-02e7-494e-9784-a23947a72cd2 in Status: UNINITIALIZED for 2s [ 842.349344] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.349627] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.349755] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.350052] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.350202] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.350353] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Segment Port b60a60a0-0679-41dc-958c-4a0cb666037c not found, creating... [ 842.350660] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.350880] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.351204] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.351568] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.351799] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.352121] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.352338] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.352408] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.352707] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.352780] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.352870] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Resource: SegmentPort with ID: b60a60a0-0679-41dc-958c-4a0cb666037c is going to be created. [ 842.377914] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 842.377914] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 842.377914] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 842.377914] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 842.377914] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 842.377914] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "port-b60a60a0-0679-41dc-958c-4a0cb666037c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.074602] env[67094]: INFO networking_nsxv3.common.synchronization [req-e1de0449-624a-4a33-b5ae-04871919bc7f req-bbe95b6c-72de-48f1-b933-2bab4f8b53b5 service nova] Enqueued Resource ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 with Priority: HIGHEST for action security_group_rules [ 843.074602] env[67094]: INFO networking_nsxv3.common.synchronization [req-e1de0449-624a-4a33-b5ae-04871919bc7f req-bbe95b6c-72de-48f1-b933-2bab4f8b53b5 service nova] Enqueued Resource ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 with Priority: HIGHEST for action security_group_members [ 843.074602] env[67094]: INFO networking_nsxv3.common.synchronization [req-e1de0449-624a-4a33-b5ae-04871919bc7f req-bbe95b6c-72de-48f1-b933-2bab4f8b53b5 service nova] Enqueued Resource ID: b60a60a0-0679-41dc-958c-4a0cb666037c with Priority: HIGHEST for action port [ 843.075578] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 with Priority: HIGHEST for action security_group_rules [ 843.075658] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 with Priority: HIGHEST for action security_group_members [ 843.075800] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b60a60a0-0679-41dc-958c-4a0cb666037c with Priority: HIGHEST for action port [ 843.076407] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.076619] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.076666] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.077749] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.077749] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.079116] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.079116] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.079116] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.079116] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.079311] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.079311] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.079392] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.079691] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.079691] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.079691] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.082524] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-b60a60a0-0679-41dc-958c-4a0cb666037c taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.082524] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b60a60a0-0679-41dc-958c-4a0cb666037c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.082524] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b60a60a0-0679-41dc-958c-4a0cb666037c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.082524] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b60a60a0-0679-41dc-958c-4a0cb666037c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.082524] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b60a60a0-0679-41dc-958c-4a0cb666037c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.579196] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.579426] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.581806] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.584669] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b60a60a0-0679-41dc-958c-4a0cb666037c with status ACTIVE [ 843.584669] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.584921] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.584921] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.584986] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.585082] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.585259] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.585359] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.585423] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.585587] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.585665] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.585847] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.585940] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.586013] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.586163] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.586354] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.586450] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b60a60a0-0679-41dc-958c-4a0cb666037c is going to be updated. [ 843.607679] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.607843] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.607884] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.608096] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.608234] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.608470] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b60a60a0-0679-41dc-958c-4a0cb666037c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.898801] env[67094]: INFO networking_nsxv3.common.synchronization [req-2d2256a6-b086-48e4-84c8-35ced1ea8a87 req-ba169298-34e0-459c-a303-570ccc80d045 tempest-ServersAdminTestJSON-236082081 tempest-ServersAdminTestJSON-236082081-project-member] Enqueued Resource ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f with Priority: HIGHEST for action security_group_members [ 843.899389] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f with Priority: HIGHEST for action security_group_members [ 843.899711] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f2ac94a-4beb-4e79-8490-47989224cf9f taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.899872] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.899947] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.900170] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.900327] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.900428] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.900490] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.900660] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.900750] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.900841] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f2ac94a-4beb-4e79-8490-47989224cf9f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 843.987215] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c0d7199-02e7-494e-9784-a23947a72cd2 in Status: SUCCESS [ 843.987449] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c0d7199-02e7-494e-9784-a23947a72cd2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.987604] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c0d7199-02e7-494e-9784-a23947a72cd2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.987826] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c0d7199-02e7-494e-9784-a23947a72cd2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.988030] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 843.988146] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 843.988212] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 843.988388] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 843.988478] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.988590] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c0d7199-02e7-494e-9784-a23947a72cd2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 843.988655] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1c0d7199-02e7-494e-9784-a23947a72cd2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.083875] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.262766] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock network-107 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.262895] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "network-107" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.263163] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "network-107" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.263312] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "network-107" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.263549] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.263720] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.264220] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.264220] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.264309] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.264590] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 844.264726] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 844.264918] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 844.264973] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 844.265203] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 844.265257] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 844.265426] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 844.289600] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 844.289735] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 844.289915] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 844.290377] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "network-107" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.290569] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock port-8a6fbf45-baff-4e74-b553-170fa4500764 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.290807] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "port-8a6fbf45-baff-4e74-b553-170fa4500764" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.290951] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "port-8a6fbf45-baff-4e74-b553-170fa4500764" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.291310] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "port-8a6fbf45-baff-4e74-b553-170fa4500764" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.291454] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a6fbf45-baff-4e74-b553-170fa4500764',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.402488] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0f2ac94a-4beb-4e79-8490-47989224cf9f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.491156] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c0d7199-02e7-494e-9784-a23947a72cd2 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.491340] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c0d7199-02e7-494e-9784-a23947a72cd2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.491396] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c0d7199-02e7-494e-9784-a23947a72cd2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.491628] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c0d7199-02e7-494e-9784-a23947a72cd2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.491806] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.491908] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.491990] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.492159] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.492258] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.492346] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c0d7199-02e7-494e-9784-a23947a72cd2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.492489] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c0d7199-02e7-494e-9784-a23947a72cd2 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.492588] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c0d7199-02e7-494e-9784-a23947a72cd2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.492649] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c0d7199-02e7-494e-9784-a23947a72cd2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.492777] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c0d7199-02e7-494e-9784-a23947a72cd2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.492912] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.493007] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.493076] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.494175] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.494175] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.494175] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c0d7199-02e7-494e-9784-a23947a72cd2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.494175] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1c0d7199-02e7-494e-9784-a23947a72cd2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.587508] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.587665] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.587747] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.587961] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.588085] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.588191] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 is going to be created. [ 844.615431] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.615581] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.615647] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.615857] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.616251] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.626400] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 in Status: UNINITIALIZED for 2s [ 844.797335] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.797335] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.797335] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.797335] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.797335] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.797335] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Segment Port 8a6fbf45-baff-4e74-b553-170fa4500764 not found, creating... [ 844.797335] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.797335] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.797335] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.797335] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.798180] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.798180] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.798180] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.798180] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.798405] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.798405] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.799129] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Resource: SegmentPort with ID: 8a6fbf45-baff-4e74-b553-170fa4500764 is going to be created. [ 844.822108] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 844.822108] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 844.822108] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 844.822108] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 844.822610] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.822610] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "port-8a6fbf45-baff-4e74-b553-170fa4500764" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 844.906318] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0f2ac94a-4beb-4e79-8490-47989224cf9f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 844.998168] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1c0d7199-02e7-494e-9784-a23947a72cd2: rpc.has_security_group_logging(os_id): False [ 845.025233] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.025527] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.025527] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.025706] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.025818] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.026022] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.026137] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.026197] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.026482] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.026568] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.026862] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.026952] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.026952] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.027444] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.027444] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.027444] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.027661] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.027661] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.027723] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.027756] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.027846] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1c0d7199-02e7-494e-9784-a23947a72cd2 is going to be created. [ 845.094881] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.095349] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.095349] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.095349] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.095480] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.110213] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c0d7199-02e7-494e-9784-a23947a72cd2 in Status: IN_PROGRESS for 2s [ 845.407659] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.407818] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.407818] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.408044] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.408129] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.408232] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f is going to be updated. [ 845.438714] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.438714] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.438714] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.438714] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.439036] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 845.447894] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f in Status: IN_PROGRESS for 2s [ 845.533188] env[67094]: INFO networking_nsxv3.common.synchronization [req-2d2256a6-b086-48e4-84c8-35ced1ea8a87 req-1c315c3a-e564-4d20-8e3e-aca4b2a8eca1 service nova] Enqueued Resource ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f with Priority: HIGHEST for action security_group_rules [ 845.533188] env[67094]: INFO networking_nsxv3.common.synchronization [req-2d2256a6-b086-48e4-84c8-35ced1ea8a87 req-1c315c3a-e564-4d20-8e3e-aca4b2a8eca1 service nova] Enqueued Resource ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f with Priority: HIGHEST for action security_group_members [ 845.533328] env[67094]: INFO networking_nsxv3.common.synchronization [req-2d2256a6-b086-48e4-84c8-35ced1ea8a87 req-1c315c3a-e564-4d20-8e3e-aca4b2a8eca1 service nova] Enqueued Resource ID: 8a6fbf45-baff-4e74-b553-170fa4500764 with Priority: HIGHEST for action port [ 845.533554] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f with Priority: HIGHEST for action security_group_rules [ 845.533676] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f with Priority: HIGHEST for action security_group_members [ 845.533769] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a6fbf45-baff-4e74-b553-170fa4500764 with Priority: HIGHEST for action port [ 845.535539] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0f2ac94a-4beb-4e79-8490-47989224cf9f taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.535687] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.535755] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.535967] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.536871] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0f2ac94a-4beb-4e79-8490-47989224cf9f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 845.537490] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f2ac94a-4beb-4e79-8490-47989224cf9f taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.537490] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.537906] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-8a6fbf45-baff-4e74-b553-170fa4500764 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 845.537906] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8a6fbf45-baff-4e74-b553-170fa4500764" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 845.537906] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8a6fbf45-baff-4e74-b553-170fa4500764" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 845.538225] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8a6fbf45-baff-4e74-b553-170fa4500764" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 845.538225] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a6fbf45-baff-4e74-b553-170fa4500764',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.039750] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f2ac94a-4beb-4e79-8490-47989224cf9f taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.039919] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.040139] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8a6fbf45-baff-4e74-b553-170fa4500764 with status ACTIVE [ 846.040311] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.040442] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.040506] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.040795] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.040886] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.041082] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.041197] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.041197] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.041816] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.041816] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.041816] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.041816] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.041816] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.042218] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.042218] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.042218] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8a6fbf45-baff-4e74-b553-170fa4500764 is going to be updated. [ 846.067247] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.067477] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.067522] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.067750] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.067899] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.068083] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8a6fbf45-baff-4e74-b553-170fa4500764" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.637847] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 in Status: SUCCESS [ 846.638397] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.638397] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.638593] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.638804] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.638922] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.639026] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.639215] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.639333] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.639465] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.639557] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 846.734811] env[67094]: INFO networking_nsxv3.common.synchronization [req-af0dc548-e8d5-46f0-8452-3171177f1cd3 req-4daa6447-79fd-4fcd-96d6-dd16a51c71d8 tempest-ServerRescueNegativeTestJSON-389115858 tempest-ServerRescueNegativeTestJSON-389115858-project-member] Enqueued Resource ID: 34b6178d-c850-4655-81a1-f452d6a6f576 with Priority: HIGHEST for action security_group_members [ 846.735541] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34b6178d-c850-4655-81a1-f452d6a6f576 with Priority: HIGHEST for action security_group_members [ 846.735873] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-34b6178d-c850-4655-81a1-f452d6a6f576 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.736175] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34b6178d-c850-4655-81a1-f452d6a6f576" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.736287] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34b6178d-c850-4655-81a1-f452d6a6f576" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.736577] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34b6178d-c850-4655-81a1-f452d6a6f576" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.736747] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 846.736854] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 846.736936] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 846.737083] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 846.737164] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 846.737258] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34b6178d-c850-4655-81a1-f452d6a6f576',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.123049] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock network-861 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.123387] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "network-861" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.123566] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "network-861" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.123925] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "network-861" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.124263] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.124585] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.124659] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.124860] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.124993] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.125206] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 847.125309] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 847.125410] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 847.125510] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 847.125610] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 847.127027] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 847.127027] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 847.130946] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1c0d7199-02e7-494e-9784-a23947a72cd2 in Status: SUCCESS [ 847.131170] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1c0d7199-02e7-494e-9784-a23947a72cd2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.143635] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.148877] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 847.150520] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 847.150520] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 847.150520] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "network-861" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.150900] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock port-07cf58d8-d2f3-4bef-a98f-f798d42613fa taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.151468] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "port-07cf58d8-d2f3-4bef-a98f-f798d42613fa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.152022] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "port-07cf58d8-d2f3-4bef-a98f-f798d42613fa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.152945] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "port-07cf58d8-d2f3-4bef-a98f-f798d42613fa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.152945] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('07cf58d8-d2f3-4bef-a98f-f798d42613fa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.240439] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.240620] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.240713] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.241504] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.241504] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.241504] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.241778] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.241778] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.241951] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.242081] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.242601] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34b6178d-c850-4655-81a1-f452d6a6f576 already deleted. [ 847.242601] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34b6178d-c850-4655-81a1-f452d6a6f576" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.458653] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f in Status: SUCCESS [ 847.458904] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.459100] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.459356] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.459574] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.459706] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.460491] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.460491] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.460491] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.460491] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f2ac94a-4beb-4e79-8490-47989224cf9f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 847.646542] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9: rpc.has_security_group_logging(os_id): False [ 847.657296] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.657645] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.657795] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.658231] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.658478] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.658640] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Segment Port 07cf58d8-d2f3-4bef-a98f-f798d42613fa not found, creating... [ 847.658928] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.659101] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.659226] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.663189] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.663189] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.663189] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.663189] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.663189] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.663189] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.663189] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.663189] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Resource: SegmentPort with ID: 07cf58d8-d2f3-4bef-a98f-f798d42613fa is going to be created. [ 847.667357] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.667555] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.667655] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.667829] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.667894] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.668170] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.668320] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.668320] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.668514] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.668750] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.668750] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 is going to be created. [ 847.683694] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.683694] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.683694] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.683694] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.684227] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.684333] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "port-07cf58d8-d2f3-4bef-a98f-f798d42613fa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.749150] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 847.749384] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 847.749475] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 847.749685] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 847.749868] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 847.763555] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 in Status: IN_PROGRESS for 2s [ 847.962256] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0f2ac94a-4beb-4e79-8490-47989224cf9f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.466366] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0f2ac94a-4beb-4e79-8490-47989224cf9f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.534310] env[67094]: INFO networking_nsxv3.common.synchronization [req-af0dc548-e8d5-46f0-8452-3171177f1cd3 req-9f221433-ad49-46d0-a72b-891b9af63510 service nova] Enqueued Resource ID: 34b6178d-c850-4655-81a1-f452d6a6f576 with Priority: HIGHEST for action security_group_rules [ 848.534502] env[67094]: INFO networking_nsxv3.common.synchronization [req-af0dc548-e8d5-46f0-8452-3171177f1cd3 req-9f221433-ad49-46d0-a72b-891b9af63510 service nova] Enqueued Resource ID: 34b6178d-c850-4655-81a1-f452d6a6f576 with Priority: HIGHEST for action security_group_members [ 848.534676] env[67094]: INFO networking_nsxv3.common.synchronization [req-af0dc548-e8d5-46f0-8452-3171177f1cd3 req-9f221433-ad49-46d0-a72b-891b9af63510 service nova] Enqueued Resource ID: 07cf58d8-d2f3-4bef-a98f-f798d42613fa with Priority: HIGHEST for action port [ 848.535294] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34b6178d-c850-4655-81a1-f452d6a6f576 with Priority: HIGHEST for action security_group_rules [ 848.535435] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34b6178d-c850-4655-81a1-f452d6a6f576 with Priority: HIGHEST for action security_group_members [ 848.535540] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 07cf58d8-d2f3-4bef-a98f-f798d42613fa with Priority: HIGHEST for action port [ 848.535834] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-34b6178d-c850-4655-81a1-f452d6a6f576 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.535967] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-34b6178d-c850-4655-81a1-f452d6a6f576" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.536220] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-34b6178d-c850-4655-81a1-f452d6a6f576" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.536552] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-34b6178d-c850-4655-81a1-f452d6a6f576" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.536667] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('34b6178d-c850-4655-81a1-f452d6a6f576',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.537637] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-34b6178d-c850-4655-81a1-f452d6a6f576 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.537768] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34b6178d-c850-4655-81a1-f452d6a6f576" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.537855] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34b6178d-c850-4655-81a1-f452d6a6f576" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.538879] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34b6178d-c850-4655-81a1-f452d6a6f576" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.538879] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.538879] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.538879] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.539067] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.539067] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.539138] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34b6178d-c850-4655-81a1-f452d6a6f576',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.542284] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-07cf58d8-d2f3-4bef-a98f-f798d42613fa taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.542284] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-07cf58d8-d2f3-4bef-a98f-f798d42613fa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.542284] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-07cf58d8-d2f3-4bef-a98f-f798d42613fa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.542284] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-07cf58d8-d2f3-4bef-a98f-f798d42613fa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.542284] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('07cf58d8-d2f3-4bef-a98f-f798d42613fa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 848.968589] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.968895] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.968895] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.969040] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.969134] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 848.969234] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f is going to be updated. [ 848.997945] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 848.999104] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 848.999104] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 848.999104] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 848.999104] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.010026] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f in Status: IN_PROGRESS for 2s [ 849.043415] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('34b6178d-c850-4655-81a1-f452d6a6f576',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.044404] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-34b6178d-c850-4655-81a1-f452d6a6f576 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.045166] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34b6178d-c850-4655-81a1-f452d6a6f576" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.045564] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 07cf58d8-d2f3-4bef-a98f-f798d42613fa with status ACTIVE [ 849.045774] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.045914] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.045995] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.046308] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.046493] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.046684] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.047924] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.047924] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.047924] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.047924] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.048201] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.048201] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.048429] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.048769] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.048874] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.049445] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 07cf58d8-d2f3-4bef-a98f-f798d42613fa is going to be updated. [ 849.074015] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.074305] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.074415] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.074714] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.074982] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.075165] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-07cf58d8-d2f3-4bef-a98f-f798d42613fa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.464067] env[67094]: INFO networking_nsxv3.common.synchronization [req-eb2b4738-4347-4af7-8e9f-af9360a2603c req-a561ffdf-36ee-4d13-82b4-93c6d229ff2f tempest-ServerDiskConfigTestJSON-51233165 tempest-ServerDiskConfigTestJSON-51233165-project-member] Enqueued Resource ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 with Priority: HIGHEST for action security_group_members [ 849.464803] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 with Priority: HIGHEST for action security_group_members [ 849.465203] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.465298] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.465348] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.465542] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.465697] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.465793] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.465845] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.465992] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.466228] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.466228] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.552923] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('34b6178d-c850-4655-81a1-f452d6a6f576',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.777566] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 in Status: SUCCESS [ 849.777869] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.803877] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock network-723 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.804437] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "network-723" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.804664] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "network-723" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.804970] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "network-723" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.805337] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.805527] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.805642] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.805887] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.806337] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.806481] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 849.806636] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 849.806774] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 849.806887] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 849.807011] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 849.807123] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 849.807277] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 849.827373] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 849.827566] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 849.827698] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 849.827896] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "network-723" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.828210] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock port-4e171eb0-d125-4657-9897-b49b510b9353 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.828467] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "port-4e171eb0-d125-4657-9897-b49b510b9353" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.828604] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "port-4e171eb0-d125-4657-9897-b49b510b9353" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.828984] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "port-4e171eb0-d125-4657-9897-b49b510b9353" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.829080] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e171eb0-d125-4657-9897-b49b510b9353',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 849.970575] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.970946] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.970946] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.971215] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.993973] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.994325] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 849.994432] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 849.994487] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 849.994692] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 849.994797] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 849.994920] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 is going to be updated. [ 850.024256] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.024419] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.024491] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.024705] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.024850] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.037807] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 in Status: IN_PROGRESS for 2s [ 850.055490] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.055683] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.055806] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.056085] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.056196] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.056320] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34b6178d-c850-4655-81a1-f452d6a6f576 is going to be created. [ 850.083794] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.083794] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.083794] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.083794] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.083794] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.092470] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34b6178d-c850-4655-81a1-f452d6a6f576 in Status: UNINITIALIZED for 2s [ 850.335341] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.335606] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.335728] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.336045] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.336203] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.336399] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Segment Port 4e171eb0-d125-4657-9897-b49b510b9353 not found, creating... [ 850.336703] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.336909] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.337049] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.337276] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.337416] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.337714] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.337860] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.337976] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.338275] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.338459] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.338606] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Resource: SegmentPort with ID: 4e171eb0-d125-4657-9897-b49b510b9353 is going to be created. [ 850.365134] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.365134] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.365134] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.365486] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.365755] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.366380] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "port-4e171eb0-d125-4657-9897-b49b510b9353" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 850.517030] env[67094]: INFO networking_nsxv3.common.synchronization [None req-f52a978b-4831-43ed-b245-e45e389b10f3 tempest-AttachInterfacesTestJSON-1117082489 tempest-AttachInterfacesTestJSON-1117082489-project-member] Enqueued Resource ID: 4338a2b6-fa27-47ec-8f93-f4223c009203 with Priority: HIGHEST for action security_group_rules [ 850.517030] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4338a2b6-fa27-47ec-8f93-f4223c009203 with Priority: HIGHEST for action security_group_rules [ 850.517030] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4338a2b6-fa27-47ec-8f93-f4223c009203 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.517030] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4338a2b6-fa27-47ec-8f93-f4223c009203" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 850.517030] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4338a2b6-fa27-47ec-8f93-f4223c009203" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 850.517860] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4338a2b6-fa27-47ec-8f93-f4223c009203" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 850.517860] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4338a2b6-fa27-47ec-8f93-f4223c009203',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 850.624661] env[67094]: INFO networking_nsxv3.common.synchronization [None req-3f1dacb8-b3b9-4a90-af57-f74c81aa477f tempest-AttachInterfacesTestJSON-1117082489 tempest-AttachInterfacesTestJSON-1117082489-project-member] Enqueued Resource ID: 4338a2b6-fa27-47ec-8f93-f4223c009203 with Priority: HIGHEST for action security_group_rules [ 850.625210] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4338a2b6-fa27-47ec-8f93-f4223c009203 with Priority: HIGHEST for action security_group_rules [ 850.625619] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4338a2b6-fa27-47ec-8f93-f4223c009203 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 850.625619] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4338a2b6-fa27-47ec-8f93-f4223c009203" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.019354] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f in Status: SUCCESS [ 851.019761] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.021080] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.021326] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.021536] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.021665] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.021736] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.021913] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.022031] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.022132] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.022237] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0f2ac94a-4beb-4e79-8490-47989224cf9f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.044848] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.044848] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.044848] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.044848] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.044848] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.044848] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4338a2b6-fa27-47ec-8f93-f4223c009203 already deleted. [ 851.044848] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4338a2b6-fa27-47ec-8f93-f4223c009203" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.044848] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4338a2b6-fa27-47ec-8f93-f4223c009203" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.044848] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4338a2b6-fa27-47ec-8f93-f4223c009203" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.044848] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4338a2b6-fa27-47ec-8f93-f4223c009203',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.072290] env[67094]: INFO networking_nsxv3.common.synchronization [req-eb2b4738-4347-4af7-8e9f-af9360a2603c req-3b76c460-f44a-4997-8a64-a8ecd24c27ec service nova] Enqueued Resource ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 with Priority: HIGHEST for action security_group_rules [ 851.072290] env[67094]: INFO networking_nsxv3.common.synchronization [req-eb2b4738-4347-4af7-8e9f-af9360a2603c req-3b76c460-f44a-4997-8a64-a8ecd24c27ec service nova] Enqueued Resource ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 with Priority: HIGHEST for action security_group_members [ 851.072290] env[67094]: INFO networking_nsxv3.common.synchronization [req-eb2b4738-4347-4af7-8e9f-af9360a2603c req-3b76c460-f44a-4997-8a64-a8ecd24c27ec service nova] Enqueued Resource ID: 4e171eb0-d125-4657-9897-b49b510b9353 with Priority: HIGHEST for action port [ 851.072960] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 with Priority: HIGHEST for action security_group_rules [ 851.073300] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 with Priority: HIGHEST for action security_group_members [ 851.073586] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4e171eb0-d125-4657-9897-b49b510b9353 with Priority: HIGHEST for action port [ 851.073989] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.074246] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.074402] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.075086] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.075332] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.077023] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.077023] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.077508] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-4e171eb0-d125-4657-9897-b49b510b9353 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.077810] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4e171eb0-d125-4657-9897-b49b510b9353" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.078112] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4e171eb0-d125-4657-9897-b49b510b9353" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.079945] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4e171eb0-d125-4657-9897-b49b510b9353" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.079945] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4e171eb0-d125-4657-9897-b49b510b9353',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.525196] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f2ac94a-4beb-4e79-8490-47989224cf9f taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.525363] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.525440] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.525652] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.525870] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.525981] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.526057] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.526222] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.526332] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.526500] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.526544] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f2ac94a-4beb-4e79-8490-47989224cf9f taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.526637] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.526693] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.526832] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.526999] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.527081] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.527117] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.527248] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.527320] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.527403] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.527493] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0f2ac94a-4beb-4e79-8490-47989224cf9f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 851.566101] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.566281] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.566472] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.567071] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.567071] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.567071] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4338a2b6-fa27-47ec-8f93-f4223c009203 already deleted. [ 851.567071] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4338a2b6-fa27-47ec-8f93-f4223c009203" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.579957] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.580157] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.580575] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4e171eb0-d125-4657-9897-b49b510b9353 with status ACTIVE [ 851.580921] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.581846] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.581846] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.581846] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.581846] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.582087] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.582215] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.582397] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.582570] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.582736] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.583013] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.584206] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.584293] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.584475] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.584563] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.584657] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4e171eb0-d125-4657-9897-b49b510b9353 is going to be updated. [ 851.608050] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 851.608238] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 851.608322] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 851.608557] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 851.608701] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 851.608896] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4e171eb0-d125-4657-9897-b49b510b9353" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.035148] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0f2ac94a-4beb-4e79-8490-47989224cf9f: rpc.has_security_group_logging(os_id): False [ 852.052128] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 in Status: SUCCESS [ 852.052128] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 deletion is rescheduled due to dependency. [ 852.052128] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.052128] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.052128] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.052128] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.052128] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.052128] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.052128] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.052128] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.052128] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.053225] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.053433] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.053491] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.053711] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.079110] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.079110] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.079110] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.079110] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.079524] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.079524] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.079524] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.079636] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.079727] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.079807] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.079848] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.080459] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.080459] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.080459] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.080702] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.080702] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.080898] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f is going to be updated. [ 852.105289] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34b6178d-c850-4655-81a1-f452d6a6f576 in Status: SUCCESS [ 852.105289] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34b6178d-c850-4655-81a1-f452d6a6f576" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.105289] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34b6178d-c850-4655-81a1-f452d6a6f576" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.105289] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34b6178d-c850-4655-81a1-f452d6a6f576" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.105289] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.105289] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.105289] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.105289] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.105289] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.105289] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34b6178d-c850-4655-81a1-f452d6a6f576" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.105289] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('34b6178d-c850-4655-81a1-f452d6a6f576',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.141974] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.142209] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.142297] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.142574] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.142812] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.163129] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f in Status: IN_PROGRESS for 2s [ 852.165577] env[67094]: INFO networking_nsxv3.common.synchronization [req-b99d56d7-2c48-42dc-80d0-9fb7738b56ff req-6e34f978-b5d9-4295-9640-97bd84260ff2 tempest-ServerRescueNegativeTestJSON-389115858 tempest-ServerRescueNegativeTestJSON-389115858-project-member] Enqueued Resource ID: 34b6178d-c850-4655-81a1-f452d6a6f576 with Priority: HIGHEST for action security_group_members [ 852.165721] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34b6178d-c850-4655-81a1-f452d6a6f576 with Priority: HIGHEST for action security_group_members [ 852.166358] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-34b6178d-c850-4655-81a1-f452d6a6f576 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.166846] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34b6178d-c850-4655-81a1-f452d6a6f576" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.166846] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34b6178d-c850-4655-81a1-f452d6a6f576" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.166846] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34b6178d-c850-4655-81a1-f452d6a6f576" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.167092] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.167092] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.167092] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.167223] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.167296] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.167354] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34b6178d-c850-4655-81a1-f452d6a6f576',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.555938] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.607023] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-34b6178d-c850-4655-81a1-f452d6a6f576 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.607162] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34b6178d-c850-4655-81a1-f452d6a6f576" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.669790] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('34b6178d-c850-4655-81a1-f452d6a6f576',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 852.677035] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock network-861 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.677244] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "network-861" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.677371] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "network-861" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.677640] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "network-861" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.678128] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.678244] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.678428] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.678868] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.678946] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.679133] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 852.679255] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 852.679367] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 852.679505] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 852.679594] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 852.679700] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 852.679832] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 852.700646] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 852.700866] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 852.701015] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 852.701191] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "network-861" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 852.701497] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock port-64fa1793-505e-4aac-8956-94f8bf8ae742 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 852.701672] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "port-64fa1793-505e-4aac-8956-94f8bf8ae742" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 852.701789] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "port-64fa1793-505e-4aac-8956-94f8bf8ae742" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 852.702113] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "port-64fa1793-505e-4aac-8956-94f8bf8ae742" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 852.702252] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('64fa1793-505e-4aac-8956-94f8bf8ae742',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.059655] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.173763] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('34b6178d-c850-4655-81a1-f452d6a6f576',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 853.204739] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.205355] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.205355] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.205722] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.205962] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.206217] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Segment Port 64fa1793-505e-4aac-8956-94f8bf8ae742 not found, creating... [ 853.206591] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.206765] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.206884] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.207123] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.207261] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.207546] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.207698] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.207826] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.208108] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.208267] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.208488] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Resource: SegmentPort with ID: 64fa1793-505e-4aac-8956-94f8bf8ae742 is going to be created. [ 853.230785] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.231242] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.231491] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.231872] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.232258] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.232614] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "port-64fa1793-505e-4aac-8956-94f8bf8ae742" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.562425] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.562638] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.562798] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.563216] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.563395] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.563531] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 is going to be updated. [ 853.598408] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.598658] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.598734] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.598913] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.599079] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.611258] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 in Status: IN_PROGRESS for 2s [ 853.677196] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.677196] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.677196] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.677196] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.677196] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.677196] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34b6178d-c850-4655-81a1-f452d6a6f576 is going to be updated. [ 853.715760] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.715760] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.715760] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.715979] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.716193] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 853.730381] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34b6178d-c850-4655-81a1-f452d6a6f576 in Status: IN_PROGRESS for 2s [ 853.995281] env[67094]: INFO networking_nsxv3.common.synchronization [req-b99d56d7-2c48-42dc-80d0-9fb7738b56ff req-8c9be6ca-23ad-41e9-91e0-0c1ca3c6386f service nova] Enqueued Resource ID: 34b6178d-c850-4655-81a1-f452d6a6f576 with Priority: HIGHEST for action security_group_rules [ 853.995281] env[67094]: INFO networking_nsxv3.common.synchronization [req-b99d56d7-2c48-42dc-80d0-9fb7738b56ff req-8c9be6ca-23ad-41e9-91e0-0c1ca3c6386f service nova] Enqueued Resource ID: 34b6178d-c850-4655-81a1-f452d6a6f576 with Priority: HIGHEST for action security_group_members [ 853.995281] env[67094]: INFO networking_nsxv3.common.synchronization [req-b99d56d7-2c48-42dc-80d0-9fb7738b56ff req-8c9be6ca-23ad-41e9-91e0-0c1ca3c6386f service nova] Enqueued Resource ID: 64fa1793-505e-4aac-8956-94f8bf8ae742 with Priority: HIGHEST for action port [ 853.995281] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34b6178d-c850-4655-81a1-f452d6a6f576 with Priority: HIGHEST for action security_group_rules [ 853.995281] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34b6178d-c850-4655-81a1-f452d6a6f576 with Priority: HIGHEST for action security_group_members [ 853.995281] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 64fa1793-505e-4aac-8956-94f8bf8ae742 with Priority: HIGHEST for action port [ 853.995700] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-34b6178d-c850-4655-81a1-f452d6a6f576 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.995700] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-34b6178d-c850-4655-81a1-f452d6a6f576" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.995700] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-34b6178d-c850-4655-81a1-f452d6a6f576 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.995847] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34b6178d-c850-4655-81a1-f452d6a6f576" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.995949] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-64fa1793-505e-4aac-8956-94f8bf8ae742 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 853.996231] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-64fa1793-505e-4aac-8956-94f8bf8ae742" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 853.996231] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-64fa1793-505e-4aac-8956-94f8bf8ae742" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 853.996352] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-64fa1793-505e-4aac-8956-94f8bf8ae742" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 853.996510] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('64fa1793-505e-4aac-8956-94f8bf8ae742',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 854.180934] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f in Status: SUCCESS [ 854.181245] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.498837] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 64fa1793-505e-4aac-8956-94f8bf8ae742 with status ACTIVE [ 854.499107] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.499247] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.499317] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.499734] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.499854] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.500070] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.500179] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.500243] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.500399] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.500477] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.500682] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.500793] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.500856] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.501009] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.501094] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.501180] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 64fa1793-505e-4aac-8956-94f8bf8ae742 is going to be updated. [ 854.527305] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.527508] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.527588] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.527848] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.528035] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.528236] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-64fa1793-505e-4aac-8956-94f8bf8ae742" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.781807] env[67094]: INFO networking_nsxv3.common.synchronization [req-77d9a479-afa0-4ba2-8020-ffda53db9ca8 req-5b9432c6-6a3b-487b-a43c-94055f18be76 tempest-ImagesOneServerNegativeTestJSON-1967011174 tempest-ImagesOneServerNegativeTestJSON-1967011174-project-member] Enqueued Resource ID: 71aa8195-5281-4a1c-b9a7-3d40e851f47e with Priority: HIGHEST for action security_group_members [ 854.782321] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71aa8195-5281-4a1c-b9a7-3d40e851f47e with Priority: HIGHEST for action security_group_members [ 854.782627] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-71aa8195-5281-4a1c-b9a7-3d40e851f47e taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.782755] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.782841] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.783213] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.783405] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 854.783536] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 854.783600] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 854.783798] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 854.783909] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 854.784038] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('71aa8195-5281-4a1c-b9a7-3d40e851f47e',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.229746] env[67094]: INFO networking_nsxv3.common.synchronization [req-508ea7ca-7a07-4612-870b-d0dfee150f68 req-4d4333c0-75a2-427f-a26e-072f85c55dba tempest-ServerPasswordTestJSON-208858571 tempest-ServerPasswordTestJSON-208858571-project-member] Enqueued Resource ID: 1c0d7199-02e7-494e-9784-a23947a72cd2 with Priority: HIGHEST for action security_group_members [ 855.230666] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1c0d7199-02e7-494e-9784-a23947a72cd2 with Priority: HIGHEST for action security_group_members [ 855.231711] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-1c0d7199-02e7-494e-9784-a23947a72cd2 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.231711] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1c0d7199-02e7-494e-9784-a23947a72cd2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.231711] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1c0d7199-02e7-494e-9784-a23947a72cd2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.233088] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1c0d7199-02e7-494e-9784-a23947a72cd2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.233088] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.233088] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.233088] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.233088] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.233088] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.233088] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1c0d7199-02e7-494e-9784-a23947a72cd2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.286376] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.286642] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.286730] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.286983] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.287112] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.287401] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.287558] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.287682] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.287868] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.287972] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.288100] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71aa8195-5281-4a1c-b9a7-3d40e851f47e is going to be deleted. [ 855.335177] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.335566] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.335566] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.335732] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.335732] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.335885] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.358297] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock network-578 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.358297] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "network-578" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.358297] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "network-578" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.358297] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "network-578" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.358297] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.358297] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.358297] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.358747] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.358747] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.362028] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 855.362028] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 855.362028] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 855.362028] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 855.362028] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 855.362028] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 855.362028] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 855.387882] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 855.388145] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 855.388354] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 855.388655] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "network-578" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.389153] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock port-856e9fff-fbd0-43f7-989f-f69b9148e477 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.389424] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "port-856e9fff-fbd0-43f7-989f-f69b9148e477" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.390242] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "port-856e9fff-fbd0-43f7-989f-f69b9148e477" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.390771] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "port-856e9fff-fbd0-43f7-989f-f69b9148e477" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.390936] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('856e9fff-fbd0-43f7-989f-f69b9148e477',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.625246] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 in Status: SUCCESS [ 855.625723] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.627030] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.627030] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.627030] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.627030] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.627030] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.627030] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.627030] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.627030] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.627030] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.738556] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.738691] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.738810] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.739062] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.739112] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.739318] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.739420] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.739480] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.739630] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.739720] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.739807] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c0d7199-02e7-494e-9784-a23947a72cd2 is going to be updated. [ 855.742180] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34b6178d-c850-4655-81a1-f452d6a6f576 in Status: SUCCESS [ 855.742180] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34b6178d-c850-4655-81a1-f452d6a6f576" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.742180] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34b6178d-c850-4655-81a1-f452d6a6f576" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.742180] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34b6178d-c850-4655-81a1-f452d6a6f576" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.742393] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.742393] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.742393] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.742552] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.742617] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.742729] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34b6178d-c850-4655-81a1-f452d6a6f576" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.742865] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-34b6178d-c850-4655-81a1-f452d6a6f576 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.742958] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34b6178d-c850-4655-81a1-f452d6a6f576" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.743018] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34b6178d-c850-4655-81a1-f452d6a6f576" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.743143] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34b6178d-c850-4655-81a1-f452d6a6f576" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.743276] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.743361] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.743426] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.744167] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.744167] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.744167] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34b6178d-c850-4655-81a1-f452d6a6f576" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.744167] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('34b6178d-c850-4655-81a1-f452d6a6f576',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.744996] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34b6178d-c850-4655-81a1-f452d6a6f576" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.745370] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34b6178d-c850-4655-81a1-f452d6a6f576" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.745370] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.745513] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.745513] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.745648] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.745737] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.745835] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34b6178d-c850-4655-81a1-f452d6a6f576',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 855.773637] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.773826] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.773874] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.774098] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.774238] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.784251] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c0d7199-02e7-494e-9784-a23947a72cd2 in Status: IN_PROGRESS for 2s [ 855.893428] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.893708] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.893900] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.894217] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.894355] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.894530] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Segment Port 856e9fff-fbd0-43f7-989f-f69b9148e477 not found, creating... [ 855.894816] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.894998] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.895151] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.895642] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.895642] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.895869] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.897115] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.899037] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.899890] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.899890] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.899890] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Resource: SegmentPort with ID: 856e9fff-fbd0-43f7-989f-f69b9148e477 is going to be created. [ 855.930685] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 855.931035] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 855.931035] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 855.931338] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 855.931560] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 855.931773] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "port-856e9fff-fbd0-43f7-989f-f69b9148e477" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.131844] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.132081] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.132081] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.132317] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.132500] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.132605] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.132669] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.132826] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.132972] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.133046] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.133178] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.133270] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.133330] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.133470] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.133608] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.133700] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.133762] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.134011] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.134011] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.134103] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.134178] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.248678] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 34b6178d-c850-4655-81a1-f452d6a6f576: rpc.has_security_group_logging(os_id): False [ 856.249969] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('34b6178d-c850-4655-81a1-f452d6a6f576',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.285309] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.285535] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.285535] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.285753] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.285933] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.286069] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.286191] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.286251] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.286421] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.286522] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.286730] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.286822] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.286883] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.287035] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.287208] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.287289] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.287369] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.287469] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.287574] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.287659] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.287727] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 34b6178d-c850-4655-81a1-f452d6a6f576 is going to be created. [ 856.379305] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.379305] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.379305] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.379305] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.379305] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.396046] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34b6178d-c850-4655-81a1-f452d6a6f576 in Status: IN_PROGRESS for 2s [ 856.638290] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6: rpc.has_security_group_logging(os_id): False [ 856.656335] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.656541] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.656622] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.656903] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.657014] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.657271] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.657378] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.657442] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.657600] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.657704] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.658499] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.658499] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.658499] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.659105] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.659105] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.659105] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.659105] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.659105] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.659461] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.659461] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.659461] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 is going to be updated. [ 856.665476] env[67094]: INFO networking_nsxv3.common.synchronization [req-77d9a479-afa0-4ba2-8020-ffda53db9ca8 req-56e507e1-b3b1-41ed-b15e-4e2be2c67f04 service nova] Enqueued Resource ID: 71aa8195-5281-4a1c-b9a7-3d40e851f47e with Priority: HIGHEST for action security_group_rules [ 856.665596] env[67094]: INFO networking_nsxv3.common.synchronization [req-77d9a479-afa0-4ba2-8020-ffda53db9ca8 req-56e507e1-b3b1-41ed-b15e-4e2be2c67f04 service nova] Enqueued Resource ID: 71aa8195-5281-4a1c-b9a7-3d40e851f47e with Priority: HIGHEST for action security_group_members [ 856.665669] env[67094]: INFO networking_nsxv3.common.synchronization [req-77d9a479-afa0-4ba2-8020-ffda53db9ca8 req-56e507e1-b3b1-41ed-b15e-4e2be2c67f04 service nova] Enqueued Resource ID: 856e9fff-fbd0-43f7-989f-f69b9148e477 with Priority: HIGHEST for action port [ 856.669266] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71aa8195-5281-4a1c-b9a7-3d40e851f47e with Priority: HIGHEST for action security_group_rules [ 856.669266] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71aa8195-5281-4a1c-b9a7-3d40e851f47e with Priority: HIGHEST for action security_group_members [ 856.669266] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 856e9fff-fbd0-43f7-989f-f69b9148e477 with Priority: HIGHEST for action port [ 856.669266] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-71aa8195-5281-4a1c-b9a7-3d40e851f47e taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.669266] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.669266] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.669266] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.669266] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('71aa8195-5281-4a1c-b9a7-3d40e851f47e',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.669266] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-71aa8195-5281-4a1c-b9a7-3d40e851f47e taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.669266] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.669266] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.669266] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.669266] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.669266] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.669266] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.670021] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.670021] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.670021] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('71aa8195-5281-4a1c-b9a7-3d40e851f47e',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.670706] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-856e9fff-fbd0-43f7-989f-f69b9148e477 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.670886] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-856e9fff-fbd0-43f7-989f-f69b9148e477" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.670923] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-856e9fff-fbd0-43f7-989f-f69b9148e477" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.671164] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-856e9fff-fbd0-43f7-989f-f69b9148e477" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.671259] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('856e9fff-fbd0-43f7-989f-f69b9148e477',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.734571] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 856.734777] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 856.734827] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 856.735025] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 856.735177] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 856.754274] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('34b6178d-c850-4655-81a1-f452d6a6f576',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 856.760386] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 in Status: IN_PROGRESS for 2s [ 857.090231] env[67094]: INFO networking_nsxv3.common.synchronization [req-d7b82234-17e2-4967-b6f2-29f2929faadc req-222f1451-265c-436b-874b-c128d3070983 tempest-FloatingIPsAssociationTestJSON-2123953573 tempest-FloatingIPsAssociationTestJSON-2123953573-project-member] Enqueued Resource ID: 79476966-6948-4fb4-811c-c9f8cee63da2 with Priority: HIGHEST for action security_group_members [ 857.090804] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79476966-6948-4fb4-811c-c9f8cee63da2 with Priority: HIGHEST for action security_group_members [ 857.091130] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-79476966-6948-4fb4-811c-c9f8cee63da2 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.091427] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.091427] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.091554] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.091668] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.091813] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.091895] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.092090] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.092175] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.092272] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('79476966-6948-4fb4-811c-c9f8cee63da2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.173417] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('71aa8195-5281-4a1c-b9a7-3d40e851f47e',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.174697] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-71aa8195-5281-4a1c-b9a7-3d40e851f47e taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.174917] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.175153] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 856e9fff-fbd0-43f7-989f-f69b9148e477 with status ACTIVE [ 857.175349] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.175486] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.175558] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.176141] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.176141] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.177188] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.177288] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.177359] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.177588] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.177757] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.178884] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.179843] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.179843] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.179843] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.179843] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.182428] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 856e9fff-fbd0-43f7-989f-f69b9148e477 is going to be updated. [ 857.205337] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.205504] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.205611] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.205750] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.205908] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.206101] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-856e9fff-fbd0-43f7-989f-f69b9148e477" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.257344] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.257842] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.257842] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.257842] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.258037] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.258037] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34b6178d-c850-4655-81a1-f452d6a6f576 is going to be updated. [ 857.318492] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.318492] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.318492] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.318492] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.318492] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.340341] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34b6178d-c850-4655-81a1-f452d6a6f576 in Status: IN_PROGRESS for 2s [ 857.594740] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.596057] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.596057] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.596057] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.617134] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.618764] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.618985] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.619118] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.619428] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.619574] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.619978] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 79476966-6948-4fb4-811c-c9f8cee63da2 is going to be updated. [ 857.653792] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.654035] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.654159] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.654474] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.654682] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.667736] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79476966-6948-4fb4-811c-c9f8cee63da2 in Status: IN_PROGRESS for 2s [ 857.676317] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('71aa8195-5281-4a1c-b9a7-3d40e851f47e',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 857.798661] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1c0d7199-02e7-494e-9784-a23947a72cd2 in Status: SUCCESS [ 857.798661] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1c0d7199-02e7-494e-9784-a23947a72cd2 deletion is rescheduled due to dependency. [ 857.798661] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1c0d7199-02e7-494e-9784-a23947a72cd2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.862635] env[67094]: INFO networking_nsxv3.common.synchronization [req-2ef8b01f-b367-48af-985a-d944f2f663b3 req-c2699302-6426-4a16-bb32-b0391d3e239c tempest-ImagesTestJSON-2097058733 tempest-ImagesTestJSON-2097058733-project-member] Enqueued Resource ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa with Priority: HIGHEST for action security_group_members [ 857.863911] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa with Priority: HIGHEST for action security_group_members [ 857.864518] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-84918628-8f8e-4d25-9c0f-17cccb58ebfa taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.864746] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.864902] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.865250] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.865623] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 857.865830] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 857.865967] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 857.866271] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 857.866523] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 857.866718] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('84918628-8f8e-4d25-9c0f-17cccb58ebfa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.178977] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.179152] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.179362] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.179577] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.179737] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.179854] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71aa8195-5281-4a1c-b9a7-3d40e851f47e is going to be created. [ 858.207125] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.207328] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.207438] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.207704] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.207929] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.221213] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71aa8195-5281-4a1c-b9a7-3d40e851f47e in Status: UNINITIALIZED for 2s [ 858.354028] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock network-842 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.354028] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "network-842" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.354028] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "network-842" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.354028] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "network-842" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.354564] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.354564] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.354564] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.354764] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.357506] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.357506] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 858.357506] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 858.357506] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 858.357506] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 858.357506] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 858.357506] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 858.357506] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 858.368629] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('84918628-8f8e-4d25-9c0f-17cccb58ebfa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.376404] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 858.376607] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 858.376786] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 858.377019] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "network-842" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.377446] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock port-43841467-0ad4-45f9-86a8-97a337cb6927 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.377668] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "port-43841467-0ad4-45f9-86a8-97a337cb6927" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.377824] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "port-43841467-0ad4-45f9-86a8-97a337cb6927" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.380321] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "port-43841467-0ad4-45f9-86a8-97a337cb6927" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.380321] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43841467-0ad4-45f9-86a8-97a337cb6927',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.412558] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34b6178d-c850-4655-81a1-f452d6a6f576 in Status: SUCCESS [ 858.413253] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-34b6178d-c850-4655-81a1-f452d6a6f576" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.413399] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-34b6178d-c850-4655-81a1-f452d6a6f576" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.413675] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-34b6178d-c850-4655-81a1-f452d6a6f576" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.413784] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('34b6178d-c850-4655-81a1-f452d6a6f576',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.774701] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 in Status: SUCCESS [ 858.774701] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.871983] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('84918628-8f8e-4d25-9c0f-17cccb58ebfa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 858.882126] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.882335] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.882458] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.882727] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.882872] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.883027] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Segment Port 43841467-0ad4-45f9-86a8-97a337cb6927 not found, creating... [ 858.883291] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.883447] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.883560] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.883776] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.883905] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.884188] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.884340] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.884454] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.888296] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.888519] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.888670] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Resource: SegmentPort with ID: 43841467-0ad4-45f9-86a8-97a337cb6927 is going to be created. [ 858.908682] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.908932] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 858.909106] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 858.909415] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 858.909689] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.909935] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "port-43841467-0ad4-45f9-86a8-97a337cb6927" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 858.918632] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-34b6178d-c850-4655-81a1-f452d6a6f576 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 858.918632] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34b6178d-c850-4655-81a1-f452d6a6f576" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.351474] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34b6178d-c850-4655-81a1-f452d6a6f576 in Status: SUCCESS [ 859.351822] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34b6178d-c850-4655-81a1-f452d6a6f576" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.351822] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34b6178d-c850-4655-81a1-f452d6a6f576" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.352105] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34b6178d-c850-4655-81a1-f452d6a6f576" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.352356] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.352545] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.352935] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.352935] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.353087] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.353171] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34b6178d-c850-4655-81a1-f452d6a6f576" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.353311] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('34b6178d-c850-4655-81a1-f452d6a6f576',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.376829] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.376829] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.376829] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.377805] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.377805] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.377805] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa is going to be updated. [ 859.423579] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.423579] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.423579] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.423579] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.423579] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.434124] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa in Status: IN_PROGRESS for 2s [ 859.659030] env[67094]: INFO networking_nsxv3.common.synchronization [req-2ef8b01f-b367-48af-985a-d944f2f663b3 req-22473939-d35a-43f7-a0d4-b1bb6e0c30e0 service nova] Enqueued Resource ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa with Priority: HIGHEST for action security_group_rules [ 859.659030] env[67094]: INFO networking_nsxv3.common.synchronization [req-2ef8b01f-b367-48af-985a-d944f2f663b3 req-22473939-d35a-43f7-a0d4-b1bb6e0c30e0 service nova] Enqueued Resource ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa with Priority: HIGHEST for action security_group_members [ 859.659030] env[67094]: INFO networking_nsxv3.common.synchronization [req-2ef8b01f-b367-48af-985a-d944f2f663b3 req-22473939-d35a-43f7-a0d4-b1bb6e0c30e0 service nova] Enqueued Resource ID: 43841467-0ad4-45f9-86a8-97a337cb6927 with Priority: HIGHEST for action port [ 859.659030] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa with Priority: HIGHEST for action security_group_rules [ 859.659030] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa with Priority: HIGHEST for action security_group_members [ 859.659030] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 43841467-0ad4-45f9-86a8-97a337cb6927 with Priority: HIGHEST for action port [ 859.659577] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-84918628-8f8e-4d25-9c0f-17cccb58ebfa taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.659929] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.661034] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.661034] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.661034] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('84918628-8f8e-4d25-9c0f-17cccb58ebfa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.662675] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-84918628-8f8e-4d25-9c0f-17cccb58ebfa taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.662675] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.662675] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-43841467-0ad4-45f9-86a8-97a337cb6927 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.662675] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-43841467-0ad4-45f9-86a8-97a337cb6927" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.662675] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-43841467-0ad4-45f9-86a8-97a337cb6927" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.662675] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-43841467-0ad4-45f9-86a8-97a337cb6927" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.662675] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('43841467-0ad4-45f9-86a8-97a337cb6927',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 859.679322] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 79476966-6948-4fb4-811c-c9f8cee63da2 in Status: SUCCESS [ 859.679560] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 79476966-6948-4fb4-811c-c9f8cee63da2 deletion is rescheduled due to dependency. [ 859.679706] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.855816] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-34b6178d-c850-4655-81a1-f452d6a6f576 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.855982] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34b6178d-c850-4655-81a1-f452d6a6f576" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.856095] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34b6178d-c850-4655-81a1-f452d6a6f576" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.856517] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34b6178d-c850-4655-81a1-f452d6a6f576" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.856517] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.856674] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.856674] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.856807] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.856894] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.856981] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34b6178d-c850-4655-81a1-f452d6a6f576" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.857144] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-34b6178d-c850-4655-81a1-f452d6a6f576 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.857253] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34b6178d-c850-4655-81a1-f452d6a6f576" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.857311] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34b6178d-c850-4655-81a1-f452d6a6f576" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.857428] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34b6178d-c850-4655-81a1-f452d6a6f576" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.857565] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 859.857655] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 859.857714] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 859.857846] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 859.857920] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.858008] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34b6178d-c850-4655-81a1-f452d6a6f576" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 859.858100] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('34b6178d-c850-4655-81a1-f452d6a6f576',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.162665] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-84918628-8f8e-4d25-9c0f-17cccb58ebfa taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.162665] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.166164] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 43841467-0ad4-45f9-86a8-97a337cb6927 with status ACTIVE [ 860.166164] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.166164] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.166164] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.166471] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.166576] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.168761] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.168761] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.168761] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.168761] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.168761] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.168761] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.168761] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.168761] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.168761] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.168761] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.168761] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 43841467-0ad4-45f9-86a8-97a337cb6927 is going to be updated. [ 860.193302] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.193302] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.193302] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.193302] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.193302] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.193302] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-43841467-0ad4-45f9-86a8-97a337cb6927" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.234416] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71aa8195-5281-4a1c-b9a7-3d40e851f47e in Status: SUCCESS [ 860.234650] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.234824] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.235117] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.235299] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.235443] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.235507] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.235653] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.235736] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.235825] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.235921] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('71aa8195-5281-4a1c-b9a7-3d40e851f47e',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 860.360371] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 34b6178d-c850-4655-81a1-f452d6a6f576: rpc.has_security_group_logging(os_id): False [ 860.391694] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.392404] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.394264] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.394609] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.394799] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.395182] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.395378] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.395500] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.395798] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.395954] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.396526] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.396707] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.396842] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.397078] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.397200] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.397514] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.397694] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.397816] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.398075] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.398177] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.398272] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 34b6178d-c850-4655-81a1-f452d6a6f576 is going to be updated. [ 860.521398] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.521612] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.521612] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.522886] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.522886] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.543940] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34b6178d-c850-4655-81a1-f452d6a6f576 in Status: IN_PROGRESS for 2s [ 860.738647] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-71aa8195-5281-4a1c-b9a7-3d40e851f47e taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.738892] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.738966] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.739220] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.739422] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.739539] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.739603] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.739758] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.739847] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.739966] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.740153] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-71aa8195-5281-4a1c-b9a7-3d40e851f47e taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.740250] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.740322] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.740444] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.740645] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 860.740723] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 860.740723] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 860.740937] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 860.741135] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.741346] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 860.741346] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('71aa8195-5281-4a1c-b9a7-3d40e851f47e',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.244156] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 71aa8195-5281-4a1c-b9a7-3d40e851f47e: rpc.has_security_group_logging(os_id): False [ 861.268521] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.268736] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.268785] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.269039] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.269114] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.269392] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.269580] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.269580] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.269701] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.270026] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.270074] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.270219] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.270298] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.270606] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.270606] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.270745] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.270830] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.270900] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.271052] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.271235] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.271280] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 71aa8195-5281-4a1c-b9a7-3d40e851f47e is going to be created. [ 861.356859] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.356859] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.356859] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.356859] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.356859] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.375034] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 71aa8195-5281-4a1c-b9a7-3d40e851f47e in Status: IN_PROGRESS for 2s [ 861.455274] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa in Status: SUCCESS [ 861.456153] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.456487] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.456584] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.456791] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 861.456937] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 861.456987] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 861.457380] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 861.457380] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 861.457483] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('84918628-8f8e-4d25-9c0f-17cccb58ebfa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 861.960308] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('84918628-8f8e-4d25-9c0f-17cccb58ebfa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.463445] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('84918628-8f8e-4d25-9c0f-17cccb58ebfa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.557518] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 34b6178d-c850-4655-81a1-f452d6a6f576 in Status: SUCCESS [ 862.557802] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-34b6178d-c850-4655-81a1-f452d6a6f576" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.828080] env[67094]: INFO networking_nsxv3.common.synchronization [req-00a9900e-7c87-4821-845e-38a6b7030a2f req-87d4b4a7-6baa-4d09-a058-de6b8aa3fee1 tempest-AttachInterfacesUnderV243Test-1867486125 tempest-AttachInterfacesUnderV243Test-1867486125-project-member] Enqueued Resource ID: 00b541f3-9964-40ec-91e3-e2aa8166f007 with Priority: HIGHEST for action security_group_members [ 862.828674] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00b541f3-9964-40ec-91e3-e2aa8166f007 with Priority: HIGHEST for action security_group_members [ 862.832705] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-00b541f3-9964-40ec-91e3-e2aa8166f007 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.832840] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00b541f3-9964-40ec-91e3-e2aa8166f007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.833013] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00b541f3-9964-40ec-91e3-e2aa8166f007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.833128] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00b541f3-9964-40ec-91e3-e2aa8166f007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.833292] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.833393] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.833447] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.833602] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.833691] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.833790] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00b541f3-9964-40ec-91e3-e2aa8166f007',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.858064] env[67094]: INFO networking_nsxv3.common.synchronization [req-00a9900e-7c87-4821-845e-38a6b7030a2f req-87d4b4a7-6baa-4d09-a058-de6b8aa3fee1 tempest-AttachInterfacesUnderV243Test-1867486125 tempest-AttachInterfacesUnderV243Test-1867486125-project-member] Enqueued Resource ID: 00b541f3-9964-40ec-91e3-e2aa8166f007 with Priority: HIGHEST for action security_group_rules [ 862.858064] env[67094]: INFO networking_nsxv3.common.synchronization [req-00a9900e-7c87-4821-845e-38a6b7030a2f req-87d4b4a7-6baa-4d09-a058-de6b8aa3fee1 tempest-AttachInterfacesUnderV243Test-1867486125 tempest-AttachInterfacesUnderV243Test-1867486125-project-member] Enqueued Resource ID: 00b541f3-9964-40ec-91e3-e2aa8166f007 with Priority: HIGHEST for action security_group_members [ 862.858405] env[67094]: INFO networking_nsxv3.common.synchronization [req-00a9900e-7c87-4821-845e-38a6b7030a2f req-87d4b4a7-6baa-4d09-a058-de6b8aa3fee1 tempest-AttachInterfacesUnderV243Test-1867486125 tempest-AttachInterfacesUnderV243Test-1867486125-project-member] Enqueued Resource ID: e38e7960-e93e-4cd0-a437-2d17f9d1a161 with Priority: HIGHEST for action port [ 862.859927] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00b541f3-9964-40ec-91e3-e2aa8166f007 with Priority: HIGHEST for action security_group_rules [ 862.859927] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00b541f3-9964-40ec-91e3-e2aa8166f007 with Priority: HIGHEST for action security_group_members [ 862.859927] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e38e7960-e93e-4cd0-a437-2d17f9d1a161 with Priority: HIGHEST for action port [ 862.860297] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00b541f3-9964-40ec-91e3-e2aa8166f007 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.862699] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00b541f3-9964-40ec-91e3-e2aa8166f007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.862807] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00b541f3-9964-40ec-91e3-e2aa8166f007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.863135] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00b541f3-9964-40ec-91e3-e2aa8166f007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.863264] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00b541f3-9964-40ec-91e3-e2aa8166f007',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.864431] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-00b541f3-9964-40ec-91e3-e2aa8166f007 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.864581] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00b541f3-9964-40ec-91e3-e2aa8166f007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.864884] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-e38e7960-e93e-4cd0-a437-2d17f9d1a161 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.865054] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e38e7960-e93e-4cd0-a437-2d17f9d1a161" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.865159] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e38e7960-e93e-4cd0-a437-2d17f9d1a161" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.865444] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e38e7960-e93e-4cd0-a437-2d17f9d1a161" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.865567] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e38e7960-e93e-4cd0-a437-2d17f9d1a161',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 862.967697] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 862.967697] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 862.967829] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 862.967956] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 862.968103] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 862.968218] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa is going to be updated. [ 863.005228] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.005228] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.005228] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.005228] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.005228] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.015407] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa in Status: IN_PROGRESS for 2s [ 863.238356] env[67094]: INFO networking_nsxv3.common.synchronization [req-38b2a4d9-f7c7-42e6-8fc8-dc6a849a275f req-6c24e516-f840-49cb-b685-1b4490537cc4 tempest-ServersNegativeTestJSON-136657224 tempest-ServersNegativeTestJSON-136657224-project-member] Enqueued Resource ID: 280210af-8e3d-42c9-8854-42bd856b9dbe with Priority: HIGHEST for action security_group_members [ 863.239132] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 280210af-8e3d-42c9-8854-42bd856b9dbe with Priority: HIGHEST for action security_group_members [ 863.239590] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-280210af-8e3d-42c9-8854-42bd856b9dbe taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.239742] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.239814] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.240081] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.240240] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.240338] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.240492] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.240621] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.240725] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.240875] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('280210af-8e3d-42c9-8854-42bd856b9dbe',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.339361] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00b541f3-9964-40ec-91e3-e2aa8166f007',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 863.371247] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-00b541f3-9964-40ec-91e3-e2aa8166f007 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.371430] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00b541f3-9964-40ec-91e3-e2aa8166f007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.372716] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e38e7960-e93e-4cd0-a437-2d17f9d1a161 with status ACTIVE [ 863.372955] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.373092] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.373092] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.373308] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.373433] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.373628] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.373730] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.373791] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.373952] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.374044] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.374234] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.374312] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.374380] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.374764] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.374764] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.374764] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e38e7960-e93e-4cd0-a437-2d17f9d1a161 is going to be updated. [ 863.393896] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 71aa8195-5281-4a1c-b9a7-3d40e851f47e in Status: SUCCESS [ 863.394277] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.401621] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.401848] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.401966] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.402296] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.402520] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.402806] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e38e7960-e93e-4cd0-a437-2d17f9d1a161" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.746028] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.746455] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.746455] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.746575] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.746625] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.746834] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 863.746943] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 863.747019] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 863.747182] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 863.747257] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.747346] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 280210af-8e3d-42c9-8854-42bd856b9dbe already deleted. [ 863.747428] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 863.841891] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00b541f3-9964-40ec-91e3-e2aa8166f007',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.024040] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock network-120 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.024040] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "network-120" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.024040] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "network-120" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.024040] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "network-120" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.025084] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.026181] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.026181] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.026521] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.026845] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.027736] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 864.027736] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 864.027736] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 864.028529] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 864.028807] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 864.030018] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 864.030018] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 864.052255] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 864.054534] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 864.054534] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 864.054534] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "network-120" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.054534] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock port-56955000-c206-4072-94ed-7f8bba9b22c7 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.054534] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "port-56955000-c206-4072-94ed-7f8bba9b22c7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.054534] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "port-56955000-c206-4072-94ed-7f8bba9b22c7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.055678] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "port-56955000-c206-4072-94ed-7f8bba9b22c7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.056088] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56955000-c206-4072-94ed-7f8bba9b22c7',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.344479] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.344952] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.344952] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.345098] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.345151] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.345276] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00b541f3-9964-40ec-91e3-e2aa8166f007 is going to be updated. [ 864.375636] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.375818] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.375818] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.377059] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.377059] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.387646] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00b541f3-9964-40ec-91e3-e2aa8166f007 in Status: IN_PROGRESS for 2s [ 864.503963] env[67094]: INFO networking_nsxv3.common.synchronization [None req-58c04ff9-1790-46a3-b5d6-5de5c254dc6c None None] Enqueued Resource ID: 6adb5e47-0110-4d49-b5ca-6bec012783fa with Priority: HIGHEST for action port [ 864.503963] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6adb5e47-0110-4d49-b5ca-6bec012783fa with Priority: HIGHEST for action port [ 864.503963] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-6adb5e47-0110-4d49-b5ca-6bec012783fa taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.504743] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6adb5e47-0110-4d49-b5ca-6bec012783fa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.504933] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6adb5e47-0110-4d49-b5ca-6bec012783fa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.505297] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6adb5e47-0110-4d49-b5ca-6bec012783fa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.505523] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6adb5e47-0110-4d49-b5ca-6bec012783fa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 864.559211] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.559831] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.559831] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.560083] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.560243] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.560430] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Segment Port 56955000-c206-4072-94ed-7f8bba9b22c7 not found, creating... [ 864.560662] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.560854] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.560997] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.561330] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.561995] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.561995] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.561995] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.562189] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.562785] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.562785] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.562785] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Resource: SegmentPort with ID: 56955000-c206-4072-94ed-7f8bba9b22c7 is going to be created. [ 864.585923] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 864.586196] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 864.586320] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 864.586656] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 864.586946] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 864.587221] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "port-56955000-c206-4072-94ed-7f8bba9b22c7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.007415] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6adb5e47-0110-4d49-b5ca-6bec012783fa [ 865.007928] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.007928] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.008151] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.008486] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.008649] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.008649] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6adb5e47-0110-4d49-b5ca-6bec012783fa already deleted. [ 865.008812] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6adb5e47-0110-4d49-b5ca-6bec012783fa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.029734] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa in Status: SUCCESS [ 865.029734] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.029734] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.029734] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.029734] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.029734] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.029734] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.030137] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.030137] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.030137] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.030137] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('84918628-8f8e-4d25-9c0f-17cccb58ebfa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.352409] env[67094]: INFO networking_nsxv3.common.synchronization [req-38b2a4d9-f7c7-42e6-8fc8-dc6a849a275f req-671edfe8-2366-4ca9-adc6-4bd1b81c1d49 service nova] Enqueued Resource ID: 280210af-8e3d-42c9-8854-42bd856b9dbe with Priority: HIGHEST for action security_group_rules [ 865.352409] env[67094]: INFO networking_nsxv3.common.synchronization [req-38b2a4d9-f7c7-42e6-8fc8-dc6a849a275f req-671edfe8-2366-4ca9-adc6-4bd1b81c1d49 service nova] Enqueued Resource ID: 280210af-8e3d-42c9-8854-42bd856b9dbe with Priority: HIGHEST for action security_group_members [ 865.352409] env[67094]: INFO networking_nsxv3.common.synchronization [req-38b2a4d9-f7c7-42e6-8fc8-dc6a849a275f req-671edfe8-2366-4ca9-adc6-4bd1b81c1d49 service nova] Enqueued Resource ID: 56955000-c206-4072-94ed-7f8bba9b22c7 with Priority: HIGHEST for action port [ 865.352561] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 280210af-8e3d-42c9-8854-42bd856b9dbe with Priority: HIGHEST for action security_group_rules [ 865.352621] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 280210af-8e3d-42c9-8854-42bd856b9dbe with Priority: HIGHEST for action security_group_members [ 865.352742] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56955000-c206-4072-94ed-7f8bba9b22c7 with Priority: HIGHEST for action port [ 865.353767] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-280210af-8e3d-42c9-8854-42bd856b9dbe taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.353966] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.354073] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.354330] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.354443] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('280210af-8e3d-42c9-8854-42bd856b9dbe',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.356741] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-280210af-8e3d-42c9-8854-42bd856b9dbe taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.356919] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.356919] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.357866] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.357866] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.357866] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.357866] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.357866] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.357866] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.357866] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('280210af-8e3d-42c9-8854-42bd856b9dbe',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.359267] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-56955000-c206-4072-94ed-7f8bba9b22c7 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.359383] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-56955000-c206-4072-94ed-7f8bba9b22c7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.359504] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-56955000-c206-4072-94ed-7f8bba9b22c7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.359753] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-56955000-c206-4072-94ed-7f8bba9b22c7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.359837] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56955000-c206-4072-94ed-7f8bba9b22c7',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.533179] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-84918628-8f8e-4d25-9c0f-17cccb58ebfa taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.533404] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.533495] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.533938] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.534186] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.534322] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.534415] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.534554] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.534635] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.534720] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.534943] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-84918628-8f8e-4d25-9c0f-17cccb58ebfa taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.535078] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.535078] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.535199] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.535320] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.535422] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.535503] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.535607] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.535688] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.535755] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.535850] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('84918628-8f8e-4d25-9c0f-17cccb58ebfa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.861841] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 56955000-c206-4072-94ed-7f8bba9b22c7 with status ACTIVE [ 865.862109] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.862253] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.862333] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.862539] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.862634] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.862847] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.862977] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.863065] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.863228] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.863327] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.863498] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.863590] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.863701] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.863788] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.863876] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.863953] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 56955000-c206-4072-94ed-7f8bba9b22c7 is going to be updated. [ 865.867028] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-280210af-8e3d-42c9-8854-42bd856b9dbe taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.867156] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.867360] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('280210af-8e3d-42c9-8854-42bd856b9dbe',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 865.890546] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 865.890634] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 865.890634] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 865.890996] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 865.891088] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 865.891213] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-56955000-c206-4072-94ed-7f8bba9b22c7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.038954] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 84918628-8f8e-4d25-9c0f-17cccb58ebfa: rpc.has_security_group_logging(os_id): False [ 866.067488] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.067488] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.067488] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.067488] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.106576] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.106920] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.107119] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.107119] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.107326] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.107411] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.107598] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.107690] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.107747] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.107898] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.108073] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.108162] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.108260] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.108333] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.108518] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.111348] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.111486] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa is going to be updated. [ 866.198697] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.199189] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.199251] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.199976] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.199976] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.223138] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa in Status: IN_PROGRESS for 2s [ 866.373132] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('280210af-8e3d-42c9-8854-42bd856b9dbe',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.399666] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00b541f3-9964-40ec-91e3-e2aa8166f007 in Status: SUCCESS [ 866.399899] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00b541f3-9964-40ec-91e3-e2aa8166f007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.400097] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00b541f3-9964-40ec-91e3-e2aa8166f007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.400320] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00b541f3-9964-40ec-91e3-e2aa8166f007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.400497] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.400622] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.400673] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.401472] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.401472] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.401472] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00b541f3-9964-40ec-91e3-e2aa8166f007',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.877665] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.877832] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.877897] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.878786] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.878786] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.878786] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 280210af-8e3d-42c9-8854-42bd856b9dbe is going to be created. [ 866.880440] env[67094]: INFO networking_nsxv3.common.synchronization [None req-ea611421-c1b0-480d-9207-6aaefaf5b2a0 None None] Enqueued Resource ID: 0bfddc5e-9d34-4591-a58c-b2498454fba6 with Priority: HIGHEST for action port [ 866.881146] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0bfddc5e-9d34-4591-a58c-b2498454fba6 with Priority: HIGHEST for action port [ 866.882131] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-0bfddc5e-9d34-4591-a58c-b2498454fba6 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.882269] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0bfddc5e-9d34-4591-a58c-b2498454fba6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.882340] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0bfddc5e-9d34-4591-a58c-b2498454fba6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.882582] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0bfddc5e-9d34-4591-a58c-b2498454fba6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.882667] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0bfddc5e-9d34-4591-a58c-b2498454fba6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.903886] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00b541f3-9964-40ec-91e3-e2aa8166f007',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 866.908691] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 866.908910] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 866.909124] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 866.909451] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 866.909670] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 866.928110] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 280210af-8e3d-42c9-8854-42bd856b9dbe in Status: UNINITIALIZED for 2s [ 867.385258] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0bfddc5e-9d34-4591-a58c-b2498454fba6 [ 867.385530] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.385703] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.385796] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.386048] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.386188] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.386311] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0bfddc5e-9d34-4591-a58c-b2498454fba6 already deleted. [ 867.386425] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0bfddc5e-9d34-4591-a58c-b2498454fba6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.407819] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00b541f3-9964-40ec-91e3-e2aa8166f007',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 867.911779] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.911779] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.911779] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.911779] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.911779] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.911779] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00b541f3-9964-40ec-91e3-e2aa8166f007 is going to be updated. [ 867.940582] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 867.940582] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 867.940772] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 867.940987] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 867.941199] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 867.951942] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00b541f3-9964-40ec-91e3-e2aa8166f007 in Status: IN_PROGRESS for 2s [ 868.261260] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa in Status: SUCCESS [ 868.261260] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.334615] env[67094]: INFO networking_nsxv3.common.synchronization [req-21080f3b-e563-4eba-b416-1775e6f58227 req-96ec5f9f-1d7a-43a4-861f-b5fef57bfd45 tempest-AttachInterfacesUnderV243Test-1867486125 tempest-AttachInterfacesUnderV243Test-1867486125-project-member] Enqueued Resource ID: 00b541f3-9964-40ec-91e3-e2aa8166f007 with Priority: HIGHEST for action security_group_members [ 868.335294] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00b541f3-9964-40ec-91e3-e2aa8166f007 with Priority: HIGHEST for action security_group_members [ 868.335620] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-00b541f3-9964-40ec-91e3-e2aa8166f007 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.335729] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00b541f3-9964-40ec-91e3-e2aa8166f007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.367052] env[67094]: INFO networking_nsxv3.common.synchronization [req-21080f3b-e563-4eba-b416-1775e6f58227 req-96ec5f9f-1d7a-43a4-861f-b5fef57bfd45 tempest-AttachInterfacesUnderV243Test-1867486125 tempest-AttachInterfacesUnderV243Test-1867486125-project-member] Enqueued Resource ID: 00b541f3-9964-40ec-91e3-e2aa8166f007 with Priority: HIGHEST for action security_group_rules [ 868.367167] env[67094]: INFO networking_nsxv3.common.synchronization [req-21080f3b-e563-4eba-b416-1775e6f58227 req-96ec5f9f-1d7a-43a4-861f-b5fef57bfd45 tempest-AttachInterfacesUnderV243Test-1867486125 tempest-AttachInterfacesUnderV243Test-1867486125-project-member] Enqueued Resource ID: 00b541f3-9964-40ec-91e3-e2aa8166f007 with Priority: HIGHEST for action security_group_members [ 868.367237] env[67094]: INFO networking_nsxv3.common.synchronization [req-21080f3b-e563-4eba-b416-1775e6f58227 req-96ec5f9f-1d7a-43a4-861f-b5fef57bfd45 tempest-AttachInterfacesUnderV243Test-1867486125 tempest-AttachInterfacesUnderV243Test-1867486125-project-member] Enqueued Resource ID: e38e7960-e93e-4cd0-a437-2d17f9d1a161 with Priority: HIGHEST for action port [ 868.367825] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00b541f3-9964-40ec-91e3-e2aa8166f007 with Priority: HIGHEST for action security_group_rules [ 868.367961] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00b541f3-9964-40ec-91e3-e2aa8166f007 with Priority: HIGHEST for action security_group_members [ 868.368263] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e38e7960-e93e-4cd0-a437-2d17f9d1a161 with Priority: HIGHEST for action port [ 868.368676] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00b541f3-9964-40ec-91e3-e2aa8166f007 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.368824] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00b541f3-9964-40ec-91e3-e2aa8166f007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.368963] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-00b541f3-9964-40ec-91e3-e2aa8166f007 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.369059] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00b541f3-9964-40ec-91e3-e2aa8166f007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.369619] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-e38e7960-e93e-4cd0-a437-2d17f9d1a161 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.369619] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e38e7960-e93e-4cd0-a437-2d17f9d1a161" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.369619] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e38e7960-e93e-4cd0-a437-2d17f9d1a161" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.369619] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e38e7960-e93e-4cd0-a437-2d17f9d1a161" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.369815] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e38e7960-e93e-4cd0-a437-2d17f9d1a161',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 868.872868] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e38e7960-e93e-4cd0-a437-2d17f9d1a161 with status ACTIVE [ 868.873163] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.875151] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.875151] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.875151] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.875151] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.875151] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.875151] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.875151] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.875151] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.875151] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.875151] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.875151] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.875151] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.875151] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.875151] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.875151] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e38e7960-e93e-4cd0-a437-2d17f9d1a161 is going to be updated. [ 868.901069] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.901258] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.901301] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.902849] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.902849] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.902849] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e38e7960-e93e-4cd0-a437-2d17f9d1a161" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.938933] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 280210af-8e3d-42c9-8854-42bd856b9dbe in Status: SUCCESS [ 868.939198] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.939249] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.939506] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.939770] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 868.939905] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 868.939972] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 868.940149] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 868.940227] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.940358] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 868.940415] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('280210af-8e3d-42c9-8854-42bd856b9dbe',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.443652] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-280210af-8e3d-42c9-8854-42bd856b9dbe taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.443853] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.444439] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.444439] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.444602] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.444710] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.444776] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.444908] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.444997] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.445099] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.445249] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-280210af-8e3d-42c9-8854-42bd856b9dbe taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.445341] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.445401] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.445547] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.445682] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.445772] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.445838] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.445959] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.446050] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.446135] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.446224] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('280210af-8e3d-42c9-8854-42bd856b9dbe',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.949617] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 280210af-8e3d-42c9-8854-42bd856b9dbe: rpc.has_security_group_logging(os_id): False [ 869.964466] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00b541f3-9964-40ec-91e3-e2aa8166f007 in Status: SUCCESS [ 869.964466] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00b541f3-9964-40ec-91e3-e2aa8166f007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.965043] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00b541f3-9964-40ec-91e3-e2aa8166f007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.965148] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00b541f3-9964-40ec-91e3-e2aa8166f007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.966018] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.966018] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.966018] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.966018] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.966232] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.966361] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00b541f3-9964-40ec-91e3-e2aa8166f007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.966472] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('00b541f3-9964-40ec-91e3-e2aa8166f007',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.967720] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00b541f3-9964-40ec-91e3-e2aa8166f007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.967958] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00b541f3-9964-40ec-91e3-e2aa8166f007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.968435] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.968614] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.968653] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.968820] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.968902] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.969037] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00b541f3-9964-40ec-91e3-e2aa8166f007',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 869.973572] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.973973] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.974062] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.974248] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.974831] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.974946] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.975072] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.975133] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.976119] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.976119] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.976119] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.976119] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.976119] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.976119] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.976119] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.976405] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 869.976405] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 869.976405] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 869.976604] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 869.976657] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 869.976745] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 280210af-8e3d-42c9-8854-42bd856b9dbe is going to be created. [ 870.048291] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 870.048291] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 870.048291] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 870.048291] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 870.048291] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 870.067751] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 280210af-8e3d-42c9-8854-42bd856b9dbe in Status: IN_PROGRESS for 2s [ 870.471377] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('00b541f3-9964-40ec-91e3-e2aa8166f007',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.480505] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00b541f3-9964-40ec-91e3-e2aa8166f007',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 870.974655] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 00b541f3-9964-40ec-91e3-e2aa8166f007: rpc.has_security_group_logging(os_id): False [ 870.983431] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00b541f3-9964-40ec-91e3-e2aa8166f007',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 871.001324] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.001573] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.001696] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.002047] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.030359] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.030725] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.030867] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.030950] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.031190] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.031281] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.031374] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00b541f3-9964-40ec-91e3-e2aa8166f007 is going to be updated. [ 871.149849] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.150052] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.150128] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.150430] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.150794] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.169962] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00b541f3-9964-40ec-91e3-e2aa8166f007 in Status: IN_PROGRESS for 2s [ 871.485686] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.485943] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.486070] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.486739] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.486739] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.486739] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00b541f3-9964-40ec-91e3-e2aa8166f007 is going to be updated. [ 871.521145] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 871.521773] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 871.521773] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 871.521773] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 871.521903] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 871.532813] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00b541f3-9964-40ec-91e3-e2aa8166f007 in Status: IN_PROGRESS for 2s [ 872.085772] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 280210af-8e3d-42c9-8854-42bd856b9dbe in Status: SUCCESS [ 872.085772] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.189418] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00b541f3-9964-40ec-91e3-e2aa8166f007 in Status: SUCCESS [ 873.189692] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00b541f3-9964-40ec-91e3-e2aa8166f007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.189834] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00b541f3-9964-40ec-91e3-e2aa8166f007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.190118] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00b541f3-9964-40ec-91e3-e2aa8166f007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.190222] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00b541f3-9964-40ec-91e3-e2aa8166f007',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.368869] env[67094]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 873.368987] env[67094]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=3 [ 873.548364] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00b541f3-9964-40ec-91e3-e2aa8166f007 in Status: SUCCESS [ 873.548873] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00b541f3-9964-40ec-91e3-e2aa8166f007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.549165] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00b541f3-9964-40ec-91e3-e2aa8166f007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.549533] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00b541f3-9964-40ec-91e3-e2aa8166f007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.549915] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.550204] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 873.550350] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 873.550651] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 873.550818] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 873.551051] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00b541f3-9964-40ec-91e3-e2aa8166f007',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 873.692239] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-00b541f3-9964-40ec-91e3-e2aa8166f007 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 873.692596] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00b541f3-9964-40ec-91e3-e2aa8166f007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 874.053204] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('00b541f3-9964-40ec-91e3-e2aa8166f007',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 874.557486] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('00b541f3-9964-40ec-91e3-e2aa8166f007',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 875.059551] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.059940] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.060158] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.060534] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.060752] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.060941] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00b541f3-9964-40ec-91e3-e2aa8166f007 is going to be updated. [ 875.095703] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.095853] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.095921] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.096143] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.096286] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.107341] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00b541f3-9964-40ec-91e3-e2aa8166f007 in Status: IN_PROGRESS for 2s [ 875.616044] env[67094]: INFO networking_nsxv3.common.synchronization [req-b58b030f-d5d8-49ad-8e6b-c16cd831a5b2 req-790b919c-1f0a-496b-aa3a-152446934c85 tempest-SecurityGroupsTestJSON-1233321301 tempest-SecurityGroupsTestJSON-1233321301-project-member] Enqueued Resource ID: f7861002-4b91-437c-8519-9140d1a3bd82 with Priority: HIGHEST for action security_group_members [ 875.616928] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7861002-4b91-437c-8519-9140d1a3bd82 with Priority: HIGHEST for action security_group_members [ 875.617492] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7861002-4b91-437c-8519-9140d1a3bd82 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.617492] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.617492] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.617710] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.617806] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 875.617914] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 875.617981] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 875.618101] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 875.618180] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 875.618278] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7861002-4b91-437c-8519-9140d1a3bd82',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.011307] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock network-422 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.011611] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "network-422" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.011826] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "network-422" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.012194] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "network-422" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.012524] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.012765] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.012935] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.013338] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.013484] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.013793] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 876.014026] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 876.014150] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 876.014373] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 876.014520] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 876.014725] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 876.014877] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 876.051777] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 876.052182] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Cache value generated in 0.037 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 876.052464] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 876.053236] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "network-422" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.053236] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock port-4a2b9955-bb60-4627-a90f-504787008077 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.053372] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "port-4a2b9955-bb60-4627-a90f-504787008077" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.053774] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "port-4a2b9955-bb60-4627-a90f-504787008077" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.054177] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "port-4a2b9955-bb60-4627-a90f-504787008077" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.054364] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a2b9955-bb60-4627-a90f-504787008077',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.121893] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f7861002-4b91-437c-8519-9140d1a3bd82',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 876.515093] env[67094]: INFO networking_nsxv3.common.synchronization [req-39338544-6aea-4745-acf6-e53ba87277cc req-6ab2dd38-be81-4740-a81b-7261742ad382 tempest-AttachInterfacesUnderV243Test-1867486125 tempest-AttachInterfacesUnderV243Test-1867486125-project-member] Enqueued Resource ID: 00b541f3-9964-40ec-91e3-e2aa8166f007 with Priority: HIGHEST for action security_group_members [ 876.515866] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00b541f3-9964-40ec-91e3-e2aa8166f007 with Priority: HIGHEST for action security_group_members [ 876.516356] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-00b541f3-9964-40ec-91e3-e2aa8166f007 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.516528] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00b541f3-9964-40ec-91e3-e2aa8166f007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.560342] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.560342] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.560580] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.560977] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.561042] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.561266] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Segment Port 4a2b9955-bb60-4627-a90f-504787008077 not found, creating... [ 876.561583] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.561768] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.562028] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.563490] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.564801] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.564801] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.564801] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.565061] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.565242] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.565896] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.566124] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Resource: SegmentPort with ID: 4a2b9955-bb60-4627-a90f-504787008077 is going to be created. [ 876.593052] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 876.593052] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 876.593052] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 876.593441] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 876.593701] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.593935] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "port-4a2b9955-bb60-4627-a90f-504787008077" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 876.625780] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f7861002-4b91-437c-8519-9140d1a3bd82',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.121968] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00b541f3-9964-40ec-91e3-e2aa8166f007 in Status: SUCCESS [ 877.121968] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00b541f3-9964-40ec-91e3-e2aa8166f007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.121968] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00b541f3-9964-40ec-91e3-e2aa8166f007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.121968] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00b541f3-9964-40ec-91e3-e2aa8166f007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.121968] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.121968] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.121968] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.121968] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.121968] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.121968] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00b541f3-9964-40ec-91e3-e2aa8166f007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.122557] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('00b541f3-9964-40ec-91e3-e2aa8166f007',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.123530] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00b541f3-9964-40ec-91e3-e2aa8166f007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.123530] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00b541f3-9964-40ec-91e3-e2aa8166f007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.123650] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.124026] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.124026] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.124167] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.124167] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.124219] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00b541f3-9964-40ec-91e3-e2aa8166f007',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.129040] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.129040] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.129040] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.129197] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.129292] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.129410] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7861002-4b91-437c-8519-9140d1a3bd82 is going to be updated. [ 877.170081] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.170081] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.170823] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.170823] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.170823] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.183490] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7861002-4b91-437c-8519-9140d1a3bd82 in Status: IN_PROGRESS for 2s [ 877.403547] env[67094]: INFO networking_nsxv3.common.synchronization [req-b58b030f-d5d8-49ad-8e6b-c16cd831a5b2 req-c529b8af-6335-431f-a2ca-4a1d6c0506e6 service nova] Enqueued Resource ID: f7861002-4b91-437c-8519-9140d1a3bd82 with Priority: HIGHEST for action security_group_rules [ 877.403792] env[67094]: INFO networking_nsxv3.common.synchronization [req-b58b030f-d5d8-49ad-8e6b-c16cd831a5b2 req-c529b8af-6335-431f-a2ca-4a1d6c0506e6 service nova] Enqueued Resource ID: f7861002-4b91-437c-8519-9140d1a3bd82 with Priority: HIGHEST for action security_group_members [ 877.403897] env[67094]: INFO networking_nsxv3.common.synchronization [req-b58b030f-d5d8-49ad-8e6b-c16cd831a5b2 req-c529b8af-6335-431f-a2ca-4a1d6c0506e6 service nova] Enqueued Resource ID: 4a2b9955-bb60-4627-a90f-504787008077 with Priority: HIGHEST for action port [ 877.404442] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7861002-4b91-437c-8519-9140d1a3bd82 with Priority: HIGHEST for action security_group_rules [ 877.404613] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7861002-4b91-437c-8519-9140d1a3bd82 with Priority: HIGHEST for action security_group_members [ 877.404675] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a2b9955-bb60-4627-a90f-504787008077 with Priority: HIGHEST for action port [ 877.404954] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f7861002-4b91-437c-8519-9140d1a3bd82 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.405148] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.405308] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.405404] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.405552] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f7861002-4b91-437c-8519-9140d1a3bd82',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.406402] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7861002-4b91-437c-8519-9140d1a3bd82 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.406637] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.406637] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a2b9955-bb60-4627-a90f-504787008077 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.407144] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a2b9955-bb60-4627-a90f-504787008077" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.407144] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a2b9955-bb60-4627-a90f-504787008077" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.407144] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a2b9955-bb60-4627-a90f-504787008077" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.407144] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a2b9955-bb60-4627-a90f-504787008077',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.625935] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('00b541f3-9964-40ec-91e3-e2aa8166f007',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 877.627296] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.627441] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.627499] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.627736] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.627866] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.628467] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.628467] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.628467] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.628467] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.628716] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.628716] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00b541f3-9964-40ec-91e3-e2aa8166f007 is going to be updated. [ 877.660861] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.661106] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.661215] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.661420] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.661589] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.671110] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00b541f3-9964-40ec-91e3-e2aa8166f007 in Status: IN_PROGRESS for 2s [ 877.911111] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7861002-4b91-437c-8519-9140d1a3bd82 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.911344] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.911660] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4a2b9955-bb60-4627-a90f-504787008077 with status ACTIVE [ 877.911925] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.912123] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.912228] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.912689] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.912689] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.912962] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.913129] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.913240] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.913459] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.913576] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.913869] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.914033] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.914139] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.914391] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.914517] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.914666] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4a2b9955-bb60-4627-a90f-504787008077 is going to be updated. [ 877.942497] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 877.942719] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 877.942719] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 877.942959] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 877.943127] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 877.943659] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a2b9955-bb60-4627-a90f-504787008077" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.131776] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 00b541f3-9964-40ec-91e3-e2aa8166f007: rpc.has_security_group_logging(os_id): False [ 878.153705] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.153842] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.153909] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.154234] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.154324] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.154579] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.154726] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.154839] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.155008] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.155105] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.155202] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00b541f3-9964-40ec-91e3-e2aa8166f007 is going to be updated. [ 878.257333] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.257573] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.257643] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.257846] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.258018] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.301216] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00b541f3-9964-40ec-91e3-e2aa8166f007 in Status: IN_PROGRESS for 2s [ 878.319528] env[67094]: INFO networking_nsxv3.common.synchronization [req-84afb2cb-9204-424f-bd7a-940e2510c3b1 req-4e0a7f41-1ba7-4b21-b830-85c7f5412d61 tempest-ServersTestJSON-1070791530 tempest-ServersTestJSON-1070791530-project-member] Enqueued Resource ID: c0881101-1be1-4dbf-ac18-2d54a689202c with Priority: HIGHEST for action security_group_members [ 878.321048] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0881101-1be1-4dbf-ac18-2d54a689202c with Priority: HIGHEST for action security_group_members [ 878.321476] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0881101-1be1-4dbf-ac18-2d54a689202c taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.321636] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.321863] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.322071] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.322370] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.322566] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.322726] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.322980] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.323168] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.323351] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.792493] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock network-91 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.793279] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "network-91" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.793279] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "network-91" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.793279] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "network-91" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.793279] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.793517] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.793517] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.793949] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.793949] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.794065] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 878.794140] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 878.794241] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 878.794345] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 878.794450] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 878.794555] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 878.794696] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 878.816706] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 878.817065] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 878.817065] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 878.817230] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "network-91" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 878.817951] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock port-5fcec63f-19b4-4e58-b565-d8ee1512702a taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 878.817951] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "port-5fcec63f-19b4-4e58-b565-d8ee1512702a" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 878.817951] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "port-5fcec63f-19b4-4e58-b565-d8ee1512702a" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 878.818174] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "port-5fcec63f-19b4-4e58-b565-d8ee1512702a" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 878.818711] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5fcec63f-19b4-4e58-b565-d8ee1512702a',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 878.826807] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.197933] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7861002-4b91-437c-8519-9140d1a3bd82 in Status: IN_PROGRESS for 4s [ 879.320870] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.321148] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.321278] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.321589] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.321758] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.321933] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Segment Port 5fcec63f-19b4-4e58-b565-d8ee1512702a not found, creating... [ 879.322245] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.322421] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.322619] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.322998] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.323180] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.323582] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.323796] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.323995] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.324298] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.324486] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.324713] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Resource: SegmentPort with ID: 5fcec63f-19b4-4e58-b565-d8ee1512702a is going to be created. [ 879.332255] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 879.349450] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.349705] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.349837] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.350725] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.350725] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.350725] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "port-5fcec63f-19b4-4e58-b565-d8ee1512702a" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.685043] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00b541f3-9964-40ec-91e3-e2aa8166f007 in Status: SUCCESS [ 879.685483] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00b541f3-9964-40ec-91e3-e2aa8166f007 deletion is rescheduled due to dependency. [ 879.685841] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00b541f3-9964-40ec-91e3-e2aa8166f007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.835640] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.835640] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.836249] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.836249] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.836249] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.836438] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0881101-1be1-4dbf-ac18-2d54a689202c is going to be updated. [ 879.871706] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 879.871706] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 879.871706] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 879.872180] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 879.872459] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 879.885178] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0881101-1be1-4dbf-ac18-2d54a689202c in Status: IN_PROGRESS for 2s [ 880.124270] env[67094]: INFO networking_nsxv3.common.synchronization [req-84afb2cb-9204-424f-bd7a-940e2510c3b1 req-1c39bb94-0c2b-4e7c-bdc1-f66dd2c03ba5 service nova] Enqueued Resource ID: c0881101-1be1-4dbf-ac18-2d54a689202c with Priority: HIGHEST for action security_group_rules [ 880.124554] env[67094]: INFO networking_nsxv3.common.synchronization [req-84afb2cb-9204-424f-bd7a-940e2510c3b1 req-1c39bb94-0c2b-4e7c-bdc1-f66dd2c03ba5 service nova] Enqueued Resource ID: c0881101-1be1-4dbf-ac18-2d54a689202c with Priority: HIGHEST for action security_group_members [ 880.124927] env[67094]: INFO networking_nsxv3.common.synchronization [req-84afb2cb-9204-424f-bd7a-940e2510c3b1 req-1c39bb94-0c2b-4e7c-bdc1-f66dd2c03ba5 service nova] Enqueued Resource ID: 5fcec63f-19b4-4e58-b565-d8ee1512702a with Priority: HIGHEST for action port [ 880.126424] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0881101-1be1-4dbf-ac18-2d54a689202c with Priority: HIGHEST for action security_group_rules [ 880.126625] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0881101-1be1-4dbf-ac18-2d54a689202c with Priority: HIGHEST for action security_group_members [ 880.126739] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5fcec63f-19b4-4e58-b565-d8ee1512702a with Priority: HIGHEST for action port [ 880.127197] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0881101-1be1-4dbf-ac18-2d54a689202c taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.127286] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.127286] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.127475] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.127558] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.132498] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0881101-1be1-4dbf-ac18-2d54a689202c taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.132673] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.132835] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-5fcec63f-19b4-4e58-b565-d8ee1512702a taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.132948] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-5fcec63f-19b4-4e58-b565-d8ee1512702a" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.133485] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-5fcec63f-19b4-4e58-b565-d8ee1512702a" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.133742] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-5fcec63f-19b4-4e58-b565-d8ee1512702a" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.133835] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('5fcec63f-19b4-4e58-b565-d8ee1512702a',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.305821] env[67094]: INFO networking_nsxv3.common.synchronization [req-897b7b67-370a-4f51-8978-def5d3683fa1 req-c7926a8a-012c-450a-b85a-57d5dcdea4b6 tempest-ServerDiskConfigTestJSON-51233165 tempest-ServerDiskConfigTestJSON-51233165-project-member] Enqueued Resource ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 with Priority: HIGHEST for action security_group_members [ 880.306816] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 with Priority: HIGHEST for action security_group_members [ 880.308558] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.308882] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.309273] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.310099] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.310373] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.310689] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.310809] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.311207] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.311275] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.311415] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.326087] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 00b541f3-9964-40ec-91e3-e2aa8166f007 in Status: SUCCESS [ 880.326527] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00b541f3-9964-40ec-91e3-e2aa8166f007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.637232] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0881101-1be1-4dbf-ac18-2d54a689202c taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.637232] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.642024] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 5fcec63f-19b4-4e58-b565-d8ee1512702a with status ACTIVE [ 880.642024] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.642024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.642024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.642024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.642024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.642024] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.642024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.642024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.642024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.642024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.642024] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.642024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.642024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.642024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.642024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.642024] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 5fcec63f-19b4-4e58-b565-d8ee1512702a is going to be updated. [ 880.653877] env[67094]: INFO networking_nsxv3.common.synchronization [req-02513d0c-a9e1-4f2f-bb3e-4f9d09218b36 req-da8a69c8-5462-4b88-908c-9b6c74f9d66f tempest-ImagesTestJSON-2097058733 tempest-ImagesTestJSON-2097058733-project-member] Enqueued Resource ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa with Priority: HIGHEST for action security_group_members [ 880.654475] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa with Priority: HIGHEST for action security_group_members [ 880.654831] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-84918628-8f8e-4d25-9c0f-17cccb58ebfa taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.655021] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.655701] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.655701] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.655701] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.655701] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.655701] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.655921] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.656030] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.656152] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('84918628-8f8e-4d25-9c0f-17cccb58ebfa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.664563] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.664825] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.664908] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.665170] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.665304] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.665477] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-5fcec63f-19b4-4e58-b565-d8ee1512702a" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.764062] env[67094]: INFO networking_nsxv3.common.synchronization [req-80281898-2ff9-41a5-b6db-cc747bbe4564 req-90f17569-a758-4622-a063-5328b7b57a95 tempest-AttachVolumeTestJSON-829034394 tempest-AttachVolumeTestJSON-829034394-project-member] Enqueued Resource ID: 00f05527-967f-4b60-a2ba-dd3e2d9bad21 with Priority: HIGHEST for action security_group_members [ 880.764868] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00f05527-967f-4b60-a2ba-dd3e2d9bad21 with Priority: HIGHEST for action security_group_members [ 880.765274] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-00f05527-967f-4b60-a2ba-dd3e2d9bad21 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.765430] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-00f05527-967f-4b60-a2ba-dd3e2d9bad21" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.765511] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-00f05527-967f-4b60-a2ba-dd3e2d9bad21" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.765759] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-00f05527-967f-4b60-a2ba-dd3e2d9bad21" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.765954] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.766092] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.766173] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.766359] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.766468] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.766589] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('00f05527-967f-4b60-a2ba-dd3e2d9bad21',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 880.815743] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.815934] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.816000] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.817373] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.817373] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.817373] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.817373] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.817373] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.817373] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.817373] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.817373] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 is going to be updated. [ 880.855171] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 880.855171] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 880.855171] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 880.855171] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 880.855171] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 880.866798] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 in Status: IN_PROGRESS for 2s [ 881.161116] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('84918628-8f8e-4d25-9c0f-17cccb58ebfa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.213318] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7861002-4b91-437c-8519-9140d1a3bd82 in Status: SUCCESS [ 881.213318] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.213937] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.214324] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.214615] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.214855] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.214998] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.215261] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.216390] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.216390] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7861002-4b91-437c-8519-9140d1a3bd82',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.271542] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.271542] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.271542] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.271542] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.312225] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.312225] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.312225] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.312225] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.312225] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.312225] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.312225] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00f05527-967f-4b60-a2ba-dd3e2d9bad21 is going to be updated. [ 881.347826] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.348272] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.348272] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.348640] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.351043] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.364484] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00f05527-967f-4b60-a2ba-dd3e2d9bad21 in Status: IN_PROGRESS for 2s [ 881.664251] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('84918628-8f8e-4d25-9c0f-17cccb58ebfa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.719113] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f7861002-4b91-437c-8519-9140d1a3bd82',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 881.898518] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0881101-1be1-4dbf-ac18-2d54a689202c in Status: SUCCESS [ 881.898976] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.898976] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.899190] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.899449] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 881.899678] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 881.899767] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 881.899950] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 881.900089] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 881.900226] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.166581] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.166762] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.166874] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.167115] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.167241] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.167299] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa is going to be updated. [ 882.207755] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.207913] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.207980] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.208233] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.208378] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.220162] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa in Status: IN_PROGRESS for 2s [ 882.221549] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f7861002-4b91-437c-8519-9140d1a3bd82',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.402926] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.726504] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.726700] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.726761] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.727021] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.727113] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.727211] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7861002-4b91-437c-8519-9140d1a3bd82 is going to be updated. [ 882.761911] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.762072] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.762189] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.762462] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.762640] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.773296] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7861002-4b91-437c-8519-9140d1a3bd82 in Status: IN_PROGRESS for 2s [ 882.879574] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 in Status: SUCCESS [ 882.879872] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 deletion is rescheduled due to dependency. [ 882.880085] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.905906] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 882.957919] env[67094]: INFO networking_nsxv3.common.synchronization [req-b2226f79-f450-4b13-9a13-1e0498dbb5e1 req-59183cb8-08a5-4e7b-8471-2c61d698de2a tempest-MigrationsAdminTest-1501090521 tempest-MigrationsAdminTest-1501090521-project-member] Enqueued Resource ID: fbf0de02-2c4b-4156-ae88-4a3e624f550d with Priority: HIGHEST for action security_group_members [ 882.958508] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbf0de02-2c4b-4156-ae88-4a3e624f550d with Priority: HIGHEST for action security_group_members [ 882.958866] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbf0de02-2c4b-4156-ae88-4a3e624f550d taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.959056] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbf0de02-2c4b-4156-ae88-4a3e624f550d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.959184] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbf0de02-2c4b-4156-ae88-4a3e624f550d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.960055] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbf0de02-2c4b-4156-ae88-4a3e624f550d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.960055] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 882.960055] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 882.960055] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 882.960375] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 882.960455] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 882.960583] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fbf0de02-2c4b-4156-ae88-4a3e624f550d',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.375541] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 00f05527-967f-4b60-a2ba-dd3e2d9bad21 in Status: SUCCESS [ 883.375541] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 00f05527-967f-4b60-a2ba-dd3e2d9bad21 deletion is rescheduled due to dependency. [ 883.375541] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-00f05527-967f-4b60-a2ba-dd3e2d9bad21" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.411031] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.411031] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.411031] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.411031] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.411031] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.411031] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0881101-1be1-4dbf-ac18-2d54a689202c is going to be updated. [ 883.456520] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 883.456741] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 883.456929] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 883.457295] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 883.458041] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 883.466177] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fbf0de02-2c4b-4156-ae88-4a3e624f550d',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 883.469646] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0881101-1be1-4dbf-ac18-2d54a689202c in Status: IN_PROGRESS for 2s [ 883.968337] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fbf0de02-2c4b-4156-ae88-4a3e624f550d',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.231054] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa in Status: IN_PROGRESS for 4s [ 884.346552] env[67094]: INFO networking_nsxv3.common.synchronization [req-3b31a05b-2d25-4957-8da3-d812926d977c req-b2d430db-3445-4fef-a00b-825df925b06f tempest-ImagesOneServerNegativeTestJSON-1967011174 tempest-ImagesOneServerNegativeTestJSON-1967011174-project-member] Enqueued Resource ID: 71aa8195-5281-4a1c-b9a7-3d40e851f47e with Priority: HIGHEST for action security_group_members [ 884.348222] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71aa8195-5281-4a1c-b9a7-3d40e851f47e with Priority: HIGHEST for action security_group_members [ 884.348847] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-71aa8195-5281-4a1c-b9a7-3d40e851f47e taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.349080] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.349151] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.349627] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.349819] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.349962] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.350041] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.350224] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.350347] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.350451] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('71aa8195-5281-4a1c-b9a7-3d40e851f47e',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.471538] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.471668] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.471668] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.471914] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.472074] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.472264] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fbf0de02-2c4b-4156-ae88-4a3e624f550d is going to be updated. [ 884.515117] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.515117] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.515271] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.515455] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.515530] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.527104] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fbf0de02-2c4b-4156-ae88-4a3e624f550d in Status: IN_PROGRESS for 2s [ 884.790710] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7861002-4b91-437c-8519-9140d1a3bd82 in Status: SUCCESS [ 884.790710] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.790710] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.790710] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.795233] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.795479] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.795546] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.795756] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.795808] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.795952] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.797172] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f7861002-4b91-437c-8519-9140d1a3bd82',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 884.854087] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.855357] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.855446] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.855666] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.855765] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.856115] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.856115] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.856238] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.856666] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.856666] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.856666] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71aa8195-5281-4a1c-b9a7-3d40e851f47e is going to be updated. [ 884.888933] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 884.889089] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 884.889156] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 884.889372] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 884.889695] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 884.901135] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71aa8195-5281-4a1c-b9a7-3d40e851f47e in Status: IN_PROGRESS for 2s [ 885.300061] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7861002-4b91-437c-8519-9140d1a3bd82 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.300061] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.300061] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.300967] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.300967] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.300967] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.300967] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.300967] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.300967] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.301199] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.301309] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7861002-4b91-437c-8519-9140d1a3bd82 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.301412] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.301477] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.301667] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.301841] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.302058] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.302187] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.302412] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.302514] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.303587] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.303587] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f7861002-4b91-437c-8519-9140d1a3bd82',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.481419] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0881101-1be1-4dbf-ac18-2d54a689202c in Status: SUCCESS [ 885.481419] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.481605] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.481679] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.481889] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.482016] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.482109] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.482267] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 885.482348] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.482536] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 885.482629] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 885.805907] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f7861002-4b91-437c-8519-9140d1a3bd82: rpc.has_security_group_logging(os_id): False [ 885.829611] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 885.829611] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 885.829611] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 885.829827] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.291326] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.291326] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.291326] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.291326] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.291326] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.291326] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.291326] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.293999] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.293999] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.293999] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.293999] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.293999] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.293999] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.293999] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.293999] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.293999] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.293999] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f7861002-4b91-437c-8519-9140d1a3bd82 is going to be updated. [ 886.296764] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0881101-1be1-4dbf-ac18-2d54a689202c taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.296764] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.296764] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.300017] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.300017] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.300017] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.300017] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.300017] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.300017] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.300017] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.300017] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0881101-1be1-4dbf-ac18-2d54a689202c taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.300017] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.300017] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.300017] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.300017] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.300017] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.300017] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.300017] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.300017] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.300017] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.300017] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 886.320910] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa in Status: SUCCESS [ 886.320910] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.390764] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.391264] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.391264] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.391640] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.391882] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.417739] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7861002-4b91-437c-8519-9140d1a3bd82 in Status: IN_PROGRESS for 2s [ 886.547096] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fbf0de02-2c4b-4156-ae88-4a3e624f550d in Status: SUCCESS [ 886.547338] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbf0de02-2c4b-4156-ae88-4a3e624f550d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.809373] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c0881101-1be1-4dbf-ac18-2d54a689202c: rpc.has_security_group_logging(os_id): False [ 886.828395] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.828542] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.828671] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.828917] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.850542] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.850808] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.850989] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.850989] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.851220] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.851303] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.851496] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.851603] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.851650] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.851796] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.851870] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.852083] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.852266] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.852266] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.852433] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.852559] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.852611] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0881101-1be1-4dbf-ac18-2d54a689202c is going to be updated. [ 886.914263] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71aa8195-5281-4a1c-b9a7-3d40e851f47e in Status: SUCCESS [ 886.914263] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71aa8195-5281-4a1c-b9a7-3d40e851f47e deletion is rescheduled due to dependency. [ 886.914993] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.928069] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 886.928069] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 886.928069] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 886.928253] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 886.928452] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 886.953694] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0881101-1be1-4dbf-ac18-2d54a689202c in Status: IN_PROGRESS for 2s [ 887.073470] env[67094]: INFO networking_nsxv3.common.synchronization [req-2692dd1a-a86d-43d0-942a-440e9fcb4073 req-ff7178e8-c8dc-48b6-836e-fd7cdf71b886 tempest-SecurityGroupsTestJSON-1233321301 tempest-SecurityGroupsTestJSON-1233321301-project-member] Enqueued Resource ID: f7861002-4b91-437c-8519-9140d1a3bd82 with Priority: HIGHEST for action security_group_members [ 887.073470] env[67094]: INFO networking_nsxv3.common.synchronization [req-2692dd1a-a86d-43d0-942a-440e9fcb4073 req-ff7178e8-c8dc-48b6-836e-fd7cdf71b886 tempest-SecurityGroupsTestJSON-1233321301 tempest-SecurityGroupsTestJSON-1233321301-project-member] Enqueued Resource ID: a300461d-04cc-44a3-bc50-afbfc1076857 with Priority: HIGHEST for action security_group_members [ 887.074070] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7861002-4b91-437c-8519-9140d1a3bd82 with Priority: HIGHEST for action security_group_members [ 887.074213] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a300461d-04cc-44a3-bc50-afbfc1076857 with Priority: HIGHEST for action security_group_members [ 887.074498] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7861002-4b91-437c-8519-9140d1a3bd82 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.074713] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.074713] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.074873] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.078024] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.078024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.078024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.078024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.078024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.078024] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7861002-4b91-437c-8519-9140d1a3bd82',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.078024] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-a300461d-04cc-44a3-bc50-afbfc1076857 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.078024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a300461d-04cc-44a3-bc50-afbfc1076857" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.078024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a300461d-04cc-44a3-bc50-afbfc1076857" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.078024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a300461d-04cc-44a3-bc50-afbfc1076857" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.078024] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.078024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.078024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.078024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.078024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.078829] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a300461d-04cc-44a3-bc50-afbfc1076857',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.124596] env[67094]: INFO networking_nsxv3.common.synchronization [req-2692dd1a-a86d-43d0-942a-440e9fcb4073 req-ff7178e8-c8dc-48b6-836e-fd7cdf71b886 tempest-SecurityGroupsTestJSON-1233321301 tempest-SecurityGroupsTestJSON-1233321301-project-member] Enqueued Resource ID: a300461d-04cc-44a3-bc50-afbfc1076857 with Priority: HIGHEST for action security_group_rules [ 887.124789] env[67094]: INFO networking_nsxv3.common.synchronization [req-2692dd1a-a86d-43d0-942a-440e9fcb4073 req-ff7178e8-c8dc-48b6-836e-fd7cdf71b886 tempest-SecurityGroupsTestJSON-1233321301 tempest-SecurityGroupsTestJSON-1233321301-project-member] Enqueued Resource ID: a300461d-04cc-44a3-bc50-afbfc1076857 with Priority: HIGHEST for action security_group_members [ 887.124929] env[67094]: INFO networking_nsxv3.common.synchronization [req-2692dd1a-a86d-43d0-942a-440e9fcb4073 req-ff7178e8-c8dc-48b6-836e-fd7cdf71b886 tempest-SecurityGroupsTestJSON-1233321301 tempest-SecurityGroupsTestJSON-1233321301-project-member] Enqueued Resource ID: f7861002-4b91-437c-8519-9140d1a3bd82 with Priority: HIGHEST for action security_group_rules [ 887.125174] env[67094]: INFO networking_nsxv3.common.synchronization [req-2692dd1a-a86d-43d0-942a-440e9fcb4073 req-ff7178e8-c8dc-48b6-836e-fd7cdf71b886 tempest-SecurityGroupsTestJSON-1233321301 tempest-SecurityGroupsTestJSON-1233321301-project-member] Enqueued Resource ID: f7861002-4b91-437c-8519-9140d1a3bd82 with Priority: HIGHEST for action security_group_members [ 887.125369] env[67094]: INFO networking_nsxv3.common.synchronization [req-2692dd1a-a86d-43d0-942a-440e9fcb4073 req-ff7178e8-c8dc-48b6-836e-fd7cdf71b886 tempest-SecurityGroupsTestJSON-1233321301 tempest-SecurityGroupsTestJSON-1233321301-project-member] Enqueued Resource ID: 4a2b9955-bb60-4627-a90f-504787008077 with Priority: HIGHEST for action port [ 887.126613] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a300461d-04cc-44a3-bc50-afbfc1076857 with Priority: HIGHEST for action security_group_rules [ 887.126613] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7861002-4b91-437c-8519-9140d1a3bd82 with Priority: HIGHEST for action security_group_rules [ 887.126613] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a2b9955-bb60-4627-a90f-504787008077 with Priority: HIGHEST for action port [ 887.126613] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a300461d-04cc-44a3-bc50-afbfc1076857 with Priority: HIGHEST for action security_group_members [ 887.126613] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7861002-4b91-437c-8519-9140d1a3bd82 with Priority: HIGHEST for action security_group_members [ 887.126925] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a300461d-04cc-44a3-bc50-afbfc1076857 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.127182] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a300461d-04cc-44a3-bc50-afbfc1076857" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.127346] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a300461d-04cc-44a3-bc50-afbfc1076857" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.127623] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a300461d-04cc-44a3-bc50-afbfc1076857" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.127737] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a300461d-04cc-44a3-bc50-afbfc1076857',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.128831] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f7861002-4b91-437c-8519-9140d1a3bd82 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.128949] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.129203] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a2b9955-bb60-4627-a90f-504787008077 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.129338] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a2b9955-bb60-4627-a90f-504787008077" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.129424] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a2b9955-bb60-4627-a90f-504787008077" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.129724] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a2b9955-bb60-4627-a90f-504787008077" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.129793] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a2b9955-bb60-4627-a90f-504787008077',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.131707] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-a300461d-04cc-44a3-bc50-afbfc1076857 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.131707] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a300461d-04cc-44a3-bc50-afbfc1076857" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.131836] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7861002-4b91-437c-8519-9140d1a3bd82 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.131902] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.582695] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f7861002-4b91-437c-8519-9140d1a3bd82',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.584172] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a300461d-04cc-44a3-bc50-afbfc1076857',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 887.633596] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-a300461d-04cc-44a3-bc50-afbfc1076857 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.633737] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a300461d-04cc-44a3-bc50-afbfc1076857" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.633909] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4a2b9955-bb60-4627-a90f-504787008077 with status ACTIVE [ 887.634086] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.634215] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.634349] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.634498] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.634737] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.634737] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.634844] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.634885] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.635106] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.635171] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.635354] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.635447] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.635503] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.635683] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.635785] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.635876] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4a2b9955-bb60-4627-a90f-504787008077 is going to be updated. [ 887.661673] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 887.662849] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 887.662928] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 887.663220] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 887.663366] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 887.663529] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a2b9955-bb60-4627-a90f-504787008077" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.086173] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f7861002-4b91-437c-8519-9140d1a3bd82',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.087354] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a300461d-04cc-44a3-bc50-afbfc1076857',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.440157] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7861002-4b91-437c-8519-9140d1a3bd82 in Status: SUCCESS [ 888.440431] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.440591] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.440816] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.440912] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f7861002-4b91-437c-8519-9140d1a3bd82',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 888.595575] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.595914] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.595914] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.596072] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.596173] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.596274] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a300461d-04cc-44a3-bc50-afbfc1076857 is going to be created. [ 888.597786] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.597907] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.597907] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.600276] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.600860] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.600860] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7861002-4b91-437c-8519-9140d1a3bd82 is going to be updated. [ 888.632227] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.632227] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.632227] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.632227] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.632227] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.635048] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.635221] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.635269] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 888.635471] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 888.635654] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 888.645250] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7861002-4b91-437c-8519-9140d1a3bd82 in Status: IN_PROGRESS for 2s [ 888.646106] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a300461d-04cc-44a3-bc50-afbfc1076857 in Status: UNINITIALIZED for 2s [ 888.945408] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7861002-4b91-437c-8519-9140d1a3bd82 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 888.945589] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 888.969864] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0881101-1be1-4dbf-ac18-2d54a689202c in Status: SUCCESS [ 888.970161] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.868042] env[67094]: INFO networking_nsxv3.common.synchronization [req-32639da2-c64a-4f07-a580-e5568e234836 req-4ac04136-ee82-45ed-9cc8-3ed51476aadc tempest-AttachInterfacesTestJSON-1117082489 tempest-AttachInterfacesTestJSON-1117082489-project-member] Enqueued Resource ID: 4338a2b6-fa27-47ec-8f93-f4223c009203 with Priority: HIGHEST for action security_group_members [ 889.868518] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4338a2b6-fa27-47ec-8f93-f4223c009203 with Priority: HIGHEST for action security_group_members [ 889.869126] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-4338a2b6-fa27-47ec-8f93-f4223c009203 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.869126] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4338a2b6-fa27-47ec-8f93-f4223c009203" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.869126] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4338a2b6-fa27-47ec-8f93-f4223c009203" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.869412] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4338a2b6-fa27-47ec-8f93-f4223c009203" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.869572] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 889.869688] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 889.869735] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 889.869903] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 889.869993] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 889.870098] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4338a2b6-fa27-47ec-8f93-f4223c009203',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.217858] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock network-766 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.218255] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "network-766" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.218463] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "network-766" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.218881] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "network-766" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.219185] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.219349] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.219465] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.219697] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.219837] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.220079] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 890.220195] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 890.220302] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 890.220406] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 890.220513] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 890.220614] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 890.220743] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 890.247095] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 890.247315] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 890.247457] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 890.247641] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "network-766" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.247963] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock port-57c704b7-2437-45a8-a822-46214f9f1b4c taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.248154] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "port-57c704b7-2437-45a8-a822-46214f9f1b4c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.248273] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "port-57c704b7-2437-45a8-a822-46214f9f1b4c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.248601] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "port-57c704b7-2437-45a8-a822-46214f9f1b4c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.248881] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57c704b7-2437-45a8-a822-46214f9f1b4c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.372736] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.372935] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.373013] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.373261] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.373352] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.373556] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.373656] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.373791] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.373920] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.374060] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.374147] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4338a2b6-fa27-47ec-8f93-f4223c009203 already deleted. [ 890.374185] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4338a2b6-fa27-47ec-8f93-f4223c009203" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.658629] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7861002-4b91-437c-8519-9140d1a3bd82 in Status: SUCCESS [ 890.659119] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.659408] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.659749] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.660420] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.660420] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.660420] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.660661] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.660774] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.660924] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7861002-4b91-437c-8519-9140d1a3bd82',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.662985] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a300461d-04cc-44a3-bc50-afbfc1076857 in Status: SUCCESS [ 890.663329] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a300461d-04cc-44a3-bc50-afbfc1076857" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.663483] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a300461d-04cc-44a3-bc50-afbfc1076857" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.663671] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a300461d-04cc-44a3-bc50-afbfc1076857" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.663848] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.663964] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.664037] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.664183] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.664263] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.664356] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a300461d-04cc-44a3-bc50-afbfc1076857',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 890.752749] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.753032] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.753126] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.753375] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.753525] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.753707] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Segment Port 57c704b7-2437-45a8-a822-46214f9f1b4c not found, creating... [ 890.753973] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.754166] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.754283] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.754510] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.754656] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.754939] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.755114] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.755228] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.755433] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.755562] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.755706] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Resource: SegmentPort with ID: 57c704b7-2437-45a8-a822-46214f9f1b4c is going to be created. [ 890.779221] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 890.779478] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 890.779541] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 890.779857] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 890.780098] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 890.780330] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "port-57c704b7-2437-45a8-a822-46214f9f1b4c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.167250] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f7861002-4b91-437c-8519-9140d1a3bd82',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.168610] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a300461d-04cc-44a3-bc50-afbfc1076857',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.496978] env[67094]: INFO networking_nsxv3.common.synchronization [None req-f279af91-e39b-418e-a971-c74b91fcd0b7 None None] Enqueued Resource ID: 7dab962d-e872-4588-aa1d-705efa16ba0c with Priority: HIGHEST for action port [ 891.497727] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7dab962d-e872-4588-aa1d-705efa16ba0c with Priority: HIGHEST for action port [ 891.498164] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-7dab962d-e872-4588-aa1d-705efa16ba0c taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.498330] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7dab962d-e872-4588-aa1d-705efa16ba0c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.499033] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7dab962d-e872-4588-aa1d-705efa16ba0c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.499033] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7dab962d-e872-4588-aa1d-705efa16ba0c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.499033] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7dab962d-e872-4588-aa1d-705efa16ba0c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.514183] env[67094]: INFO networking_nsxv3.common.synchronization [req-32639da2-c64a-4f07-a580-e5568e234836 req-90653fac-b047-4fd1-ab48-9822506c2f6c service nova] Enqueued Resource ID: 4338a2b6-fa27-47ec-8f93-f4223c009203 with Priority: HIGHEST for action security_group_rules [ 891.514183] env[67094]: INFO networking_nsxv3.common.synchronization [req-32639da2-c64a-4f07-a580-e5568e234836 req-90653fac-b047-4fd1-ab48-9822506c2f6c service nova] Enqueued Resource ID: 4338a2b6-fa27-47ec-8f93-f4223c009203 with Priority: HIGHEST for action security_group_members [ 891.514183] env[67094]: INFO networking_nsxv3.common.synchronization [req-32639da2-c64a-4f07-a580-e5568e234836 req-90653fac-b047-4fd1-ab48-9822506c2f6c service nova] Enqueued Resource ID: 57c704b7-2437-45a8-a822-46214f9f1b4c with Priority: HIGHEST for action port [ 891.515078] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4338a2b6-fa27-47ec-8f93-f4223c009203 with Priority: HIGHEST for action security_group_rules [ 891.516439] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4338a2b6-fa27-47ec-8f93-f4223c009203 with Priority: HIGHEST for action security_group_members [ 891.518101] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 57c704b7-2437-45a8-a822-46214f9f1b4c with Priority: HIGHEST for action port [ 891.518101] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4338a2b6-fa27-47ec-8f93-f4223c009203 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.518101] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4338a2b6-fa27-47ec-8f93-f4223c009203" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.518101] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4338a2b6-fa27-47ec-8f93-f4223c009203" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.518101] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4338a2b6-fa27-47ec-8f93-f4223c009203" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.518101] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4338a2b6-fa27-47ec-8f93-f4223c009203',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.523021] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-4338a2b6-fa27-47ec-8f93-f4223c009203 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.523021] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4338a2b6-fa27-47ec-8f93-f4223c009203" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.523021] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4338a2b6-fa27-47ec-8f93-f4223c009203" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.523021] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4338a2b6-fa27-47ec-8f93-f4223c009203" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.523021] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.523021] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.523021] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.523021] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.523021] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 891.523021] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4338a2b6-fa27-47ec-8f93-f4223c009203',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.523021] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-57c704b7-2437-45a8-a822-46214f9f1b4c taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 891.523021] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-57c704b7-2437-45a8-a822-46214f9f1b4c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 891.523021] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-57c704b7-2437-45a8-a822-46214f9f1b4c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 891.523021] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-57c704b7-2437-45a8-a822-46214f9f1b4c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 891.523021] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('57c704b7-2437-45a8-a822-46214f9f1b4c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.670593] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f7861002-4b91-437c-8519-9140d1a3bd82',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 891.672205] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a300461d-04cc-44a3-bc50-afbfc1076857',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.002521] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7dab962d-e872-4588-aa1d-705efa16ba0c [ 892.002521] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.002521] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.005362] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.005458] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.005552] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.005803] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7dab962d-e872-4588-aa1d-705efa16ba0c already deleted. [ 892.005803] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7dab962d-e872-4588-aa1d-705efa16ba0c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.028502] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-4338a2b6-fa27-47ec-8f93-f4223c009203 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.028502] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4338a2b6-fa27-47ec-8f93-f4223c009203" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.028502] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4338a2b6-fa27-47ec-8f93-f4223c009203',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.028999] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 57c704b7-2437-45a8-a822-46214f9f1b4c with status ACTIVE [ 892.029217] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.029331] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.029390] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.029631] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.030465] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.030465] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.030465] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.030465] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.030465] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.030465] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.030807] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.030807] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.030807] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.031122] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.031122] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.031122] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 57c704b7-2437-45a8-a822-46214f9f1b4c is going to be updated. [ 892.057691] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.057891] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.057966] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.058184] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.058323] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.058478] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-57c704b7-2437-45a8-a822-46214f9f1b4c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.176051] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.176051] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.176051] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.176051] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.176051] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.176051] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7861002-4b91-437c-8519-9140d1a3bd82 is going to be updated. [ 892.176536] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.176608] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.176685] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.176884] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.176965] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.177070] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a300461d-04cc-44a3-bc50-afbfc1076857 is going to be updated. [ 892.212863] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.213033] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.214013] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.214013] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.214013] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.218180] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.218180] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.218180] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.218180] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.218180] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.228057] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a300461d-04cc-44a3-bc50-afbfc1076857 in Status: IN_PROGRESS for 2s [ 892.228500] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7861002-4b91-437c-8519-9140d1a3bd82 in Status: IN_PROGRESS for 2s [ 892.533517] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4338a2b6-fa27-47ec-8f93-f4223c009203',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.593349] env[67094]: INFO networking_nsxv3.common.synchronization [req-27e259fb-d812-4a24-9019-4e633883d277 req-bba36e89-07fa-4b4e-8c00-d8fd7d029b4a tempest-ServerRescueTestJSON-685643514 tempest-ServerRescueTestJSON-685643514-project-member] Enqueued Resource ID: 3ece2d85-d26d-4c59-ae47-b9a59cc4de8f with Priority: HIGHEST for action security_group_members [ 892.594149] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ece2d85-d26d-4c59-ae47-b9a59cc4de8f with Priority: HIGHEST for action security_group_members [ 892.595248] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ece2d85-d26d-4c59-ae47-b9a59cc4de8f taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.595390] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ece2d85-d26d-4c59-ae47-b9a59cc4de8f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.595584] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ece2d85-d26d-4c59-ae47-b9a59cc4de8f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.595745] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ece2d85-d26d-4c59-ae47-b9a59cc4de8f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.595926] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.596034] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.596114] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.596277] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.596373] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.596468] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ece2d85-d26d-4c59-ae47-b9a59cc4de8f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 892.971799] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock network-631 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.973771] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "network-631" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.974096] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "network-631" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.974511] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "network-631" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.975208] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.975463] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.975765] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 892.977556] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 892.978027] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.978027] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 892.978164] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 892.978214] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 892.978312] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 892.978416] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 892.978516] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 892.978648] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 892.998218] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 892.998530] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 892.998755] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 892.999028] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "network-631" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 892.999470] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock port-fd022bab-da93-4567-9a01-73a5bf2355f3 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 892.999724] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "port-fd022bab-da93-4567-9a01-73a5bf2355f3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 892.999899] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "port-fd022bab-da93-4567-9a01-73a5bf2355f3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.000262] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "port-fd022bab-da93-4567-9a01-73a5bf2355f3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.000476] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd022bab-da93-4567-9a01-73a5bf2355f3',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 893.036675] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.036675] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.036675] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.036675] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.036865] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.036865] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4338a2b6-fa27-47ec-8f93-f4223c009203 is going to be created. [ 893.063415] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.063593] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.063704] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.063936] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.064174] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.076477] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4338a2b6-fa27-47ec-8f93-f4223c009203 in Status: UNINITIALIZED for 2s [ 893.100552] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.100741] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.100825] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.101416] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.101416] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.101548] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.101643] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.101797] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.101936] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.102833] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.102833] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ece2d85-d26d-4c59-ae47-b9a59cc4de8f already deleted. [ 893.102833] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ece2d85-d26d-4c59-ae47-b9a59cc4de8f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.506593] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.506593] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.506593] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.506593] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.506593] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.506593] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Segment Port fd022bab-da93-4567-9a01-73a5bf2355f3 not found, creating... [ 893.506593] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.506593] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.506593] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.506593] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.506593] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.507617] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.507617] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.507617] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.507782] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.507999] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.508212] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Resource: SegmentPort with ID: fd022bab-da93-4567-9a01-73a5bf2355f3 is going to be created. [ 893.532352] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.532558] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.532679] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.533246] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.533503] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.533758] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "port-fd022bab-da93-4567-9a01-73a5bf2355f3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 893.840060] env[67094]: INFO networking_nsxv3.common.synchronization [None req-5ba87adf-a244-412e-b30a-c5245a63a509 None None] Enqueued Resource ID: 3f9a94c2-87cd-4fec-b6a2-5af574d0abfd with Priority: HIGHEST for action port [ 893.841591] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3f9a94c2-87cd-4fec-b6a2-5af574d0abfd with Priority: HIGHEST for action port [ 893.841863] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-3f9a94c2-87cd-4fec-b6a2-5af574d0abfd taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 893.843028] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3f9a94c2-87cd-4fec-b6a2-5af574d0abfd" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 893.843028] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3f9a94c2-87cd-4fec-b6a2-5af574d0abfd" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 893.843298] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3f9a94c2-87cd-4fec-b6a2-5af574d0abfd" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 893.843360] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3f9a94c2-87cd-4fec-b6a2-5af574d0abfd',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.247832] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7861002-4b91-437c-8519-9140d1a3bd82 in Status: SUCCESS [ 894.248155] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.249207] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a300461d-04cc-44a3-bc50-afbfc1076857 in Status: SUCCESS [ 894.249432] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a300461d-04cc-44a3-bc50-afbfc1076857" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.249630] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.249902] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.250164] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.250912] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.250912] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.250912] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.250912] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.250912] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.251125] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f7861002-4b91-437c-8519-9140d1a3bd82',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.252025] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a300461d-04cc-44a3-bc50-afbfc1076857" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.252237] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a300461d-04cc-44a3-bc50-afbfc1076857" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.252502] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.252601] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.252686] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.252880] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.252987] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.253110] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a300461d-04cc-44a3-bc50-afbfc1076857" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.253235] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a300461d-04cc-44a3-bc50-afbfc1076857',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.301450] env[67094]: INFO networking_nsxv3.common.synchronization [req-27e259fb-d812-4a24-9019-4e633883d277 req-c51e27f2-9ecd-4aed-a021-b4c8ca857da4 service nova] Enqueued Resource ID: 3ece2d85-d26d-4c59-ae47-b9a59cc4de8f with Priority: HIGHEST for action security_group_rules [ 894.301450] env[67094]: INFO networking_nsxv3.common.synchronization [req-27e259fb-d812-4a24-9019-4e633883d277 req-c51e27f2-9ecd-4aed-a021-b4c8ca857da4 service nova] Enqueued Resource ID: 3ece2d85-d26d-4c59-ae47-b9a59cc4de8f with Priority: HIGHEST for action security_group_members [ 894.301450] env[67094]: INFO networking_nsxv3.common.synchronization [req-27e259fb-d812-4a24-9019-4e633883d277 req-c51e27f2-9ecd-4aed-a021-b4c8ca857da4 service nova] Enqueued Resource ID: fd022bab-da93-4567-9a01-73a5bf2355f3 with Priority: HIGHEST for action port [ 894.301450] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ece2d85-d26d-4c59-ae47-b9a59cc4de8f with Priority: HIGHEST for action security_group_rules [ 894.301794] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ece2d85-d26d-4c59-ae47-b9a59cc4de8f with Priority: HIGHEST for action security_group_members [ 894.301794] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd022bab-da93-4567-9a01-73a5bf2355f3 with Priority: HIGHEST for action port [ 894.302444] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3ece2d85-d26d-4c59-ae47-b9a59cc4de8f taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.302444] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3ece2d85-d26d-4c59-ae47-b9a59cc4de8f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.302444] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3ece2d85-d26d-4c59-ae47-b9a59cc4de8f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.302715] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3ece2d85-d26d-4c59-ae47-b9a59cc4de8f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.302715] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3ece2d85-d26d-4c59-ae47-b9a59cc4de8f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.304414] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ece2d85-d26d-4c59-ae47-b9a59cc4de8f taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.304477] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ece2d85-d26d-4c59-ae47-b9a59cc4de8f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.304532] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ece2d85-d26d-4c59-ae47-b9a59cc4de8f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.304715] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ece2d85-d26d-4c59-ae47-b9a59cc4de8f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.306035] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.306035] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.306035] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.306035] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.306035] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.306035] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ece2d85-d26d-4c59-ae47-b9a59cc4de8f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.306385] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-fd022bab-da93-4567-9a01-73a5bf2355f3 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.306385] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fd022bab-da93-4567-9a01-73a5bf2355f3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.306385] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fd022bab-da93-4567-9a01-73a5bf2355f3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.306621] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fd022bab-da93-4567-9a01-73a5bf2355f3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.306621] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd022bab-da93-4567-9a01-73a5bf2355f3',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.346644] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 3f9a94c2-87cd-4fec-b6a2-5af574d0abfd [ 894.347220] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.347485] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.347558] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.347793] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.347890] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.347989] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:3f9a94c2-87cd-4fec-b6a2-5af574d0abfd already deleted. [ 894.348267] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3f9a94c2-87cd-4fec-b6a2-5af574d0abfd" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.755724] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7861002-4b91-437c-8519-9140d1a3bd82 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.755724] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.755724] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.755724] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.756170] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.756170] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.756170] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.756170] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.756513] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.756513] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.756513] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7861002-4b91-437c-8519-9140d1a3bd82 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.756639] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.756671] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.757414] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.757414] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.757414] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.757414] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.757414] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.757414] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.757910] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.757910] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f7861002-4b91-437c-8519-9140d1a3bd82',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.758477] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a300461d-04cc-44a3-bc50-afbfc1076857',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.811360] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ece2d85-d26d-4c59-ae47-b9a59cc4de8f taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.811968] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ece2d85-d26d-4c59-ae47-b9a59cc4de8f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.811968] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3ece2d85-d26d-4c59-ae47-b9a59cc4de8f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 894.814208] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fd022bab-da93-4567-9a01-73a5bf2355f3 with status ACTIVE [ 894.814415] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.814769] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.814904] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.815152] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.815278] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.815464] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.815566] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.815629] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.815785] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.816038] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.816038] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.816137] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.816198] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.816492] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.816696] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.816820] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fd022bab-da93-4567-9a01-73a5bf2355f3 is going to be updated. [ 894.840267] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 894.840490] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 894.840490] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 894.840714] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 894.840912] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 894.841164] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fd022bab-da93-4567-9a01-73a5bf2355f3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.088223] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4338a2b6-fa27-47ec-8f93-f4223c009203 in Status: SUCCESS [ 895.088467] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4338a2b6-fa27-47ec-8f93-f4223c009203" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.091096] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4338a2b6-fa27-47ec-8f93-f4223c009203" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.091096] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4338a2b6-fa27-47ec-8f93-f4223c009203" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.091096] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.091096] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.091096] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.091096] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.091096] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.091096] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4338a2b6-fa27-47ec-8f93-f4223c009203" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.091096] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4338a2b6-fa27-47ec-8f93-f4223c009203',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.259963] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f7861002-4b91-437c-8519-9140d1a3bd82: rpc.has_security_group_logging(os_id): False [ 895.261543] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a300461d-04cc-44a3-bc50-afbfc1076857: rpc.has_security_group_logging(os_id): False [ 895.280993] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.281160] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.281242] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.281486] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.281576] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.281829] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.281949] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.282033] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.282205] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.282336] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.282408] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a300461d-04cc-44a3-bc50-afbfc1076857 is going to be created. [ 895.284095] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.284208] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.284274] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.284427] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.284512] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.284687] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.284784] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.284888] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.284992] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.285082] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.285266] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.285359] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.285420] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.285557] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.285643] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.285804] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.285892] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.286017] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.286171] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.286205] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.286296] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f7861002-4b91-437c-8519-9140d1a3bd82 is going to be updated. [ 895.315589] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3ece2d85-d26d-4c59-ae47-b9a59cc4de8f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.354097] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.354325] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.354325] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.354704] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.354704] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.357751] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.357917] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.358018] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.359035] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.359035] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.371119] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a300461d-04cc-44a3-bc50-afbfc1076857 in Status: IN_PROGRESS for 2s [ 895.379547] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7861002-4b91-437c-8519-9140d1a3bd82 in Status: IN_PROGRESS for 2s [ 895.594353] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4338a2b6-fa27-47ec-8f93-f4223c009203',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.676643] env[67094]: INFO networking_nsxv3.common.synchronization [req-c7efe786-cd3a-46ca-9a02-bb5c0f5b28f8 req-a10a2c2d-64f8-4604-b8b1-19df3ce35e34 tempest-SecurityGroupsTestJSON-1233321301 tempest-SecurityGroupsTestJSON-1233321301-project-member] Enqueued Resource ID: c35ef697-a559-4fc0-b340-e68ecaebccc7 with Priority: HIGHEST for action security_group_members [ 895.678550] env[67094]: INFO networking_nsxv3.common.synchronization [req-c7efe786-cd3a-46ca-9a02-bb5c0f5b28f8 req-a10a2c2d-64f8-4604-b8b1-19df3ce35e34 tempest-SecurityGroupsTestJSON-1233321301 tempest-SecurityGroupsTestJSON-1233321301-project-member] Enqueued Resource ID: f7861002-4b91-437c-8519-9140d1a3bd82 with Priority: HIGHEST for action security_group_members [ 895.678550] env[67094]: INFO networking_nsxv3.common.synchronization [req-c7efe786-cd3a-46ca-9a02-bb5c0f5b28f8 req-a10a2c2d-64f8-4604-b8b1-19df3ce35e34 tempest-SecurityGroupsTestJSON-1233321301 tempest-SecurityGroupsTestJSON-1233321301-project-member] Enqueued Resource ID: a300461d-04cc-44a3-bc50-afbfc1076857 with Priority: HIGHEST for action security_group_members [ 895.678550] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c35ef697-a559-4fc0-b340-e68ecaebccc7 with Priority: HIGHEST for action security_group_members [ 895.678550] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7861002-4b91-437c-8519-9140d1a3bd82 with Priority: HIGHEST for action security_group_members [ 895.678550] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a300461d-04cc-44a3-bc50-afbfc1076857 with Priority: HIGHEST for action security_group_members [ 895.678550] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-c35ef697-a559-4fc0-b340-e68ecaebccc7 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.678981] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c35ef697-a559-4fc0-b340-e68ecaebccc7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.679368] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c35ef697-a559-4fc0-b340-e68ecaebccc7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.680211] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c35ef697-a559-4fc0-b340-e68ecaebccc7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.680535] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.680679] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.680778] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.681047] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.681184] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.681322] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c35ef697-a559-4fc0-b340-e68ecaebccc7',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.683283] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7861002-4b91-437c-8519-9140d1a3bd82 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.683283] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.683283] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.683497] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.683497] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.683623] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.684777] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.684777] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.684777] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.684777] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7861002-4b91-437c-8519-9140d1a3bd82',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.686199] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-a300461d-04cc-44a3-bc50-afbfc1076857 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.686199] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a300461d-04cc-44a3-bc50-afbfc1076857" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.686199] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a300461d-04cc-44a3-bc50-afbfc1076857" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.686352] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a300461d-04cc-44a3-bc50-afbfc1076857" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.686421] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.686573] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.686641] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.687156] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.687228] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.687920] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a300461d-04cc-44a3-bc50-afbfc1076857',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.768137] env[67094]: INFO networking_nsxv3.common.synchronization [req-c7efe786-cd3a-46ca-9a02-bb5c0f5b28f8 req-a10a2c2d-64f8-4604-b8b1-19df3ce35e34 tempest-SecurityGroupsTestJSON-1233321301 tempest-SecurityGroupsTestJSON-1233321301-project-member] Enqueued Resource ID: a300461d-04cc-44a3-bc50-afbfc1076857 with Priority: HIGHEST for action security_group_rules [ 895.770175] env[67094]: INFO networking_nsxv3.common.synchronization [req-c7efe786-cd3a-46ca-9a02-bb5c0f5b28f8 req-a10a2c2d-64f8-4604-b8b1-19df3ce35e34 tempest-SecurityGroupsTestJSON-1233321301 tempest-SecurityGroupsTestJSON-1233321301-project-member] Enqueued Resource ID: a300461d-04cc-44a3-bc50-afbfc1076857 with Priority: HIGHEST for action security_group_members [ 895.772028] env[67094]: INFO networking_nsxv3.common.synchronization [req-c7efe786-cd3a-46ca-9a02-bb5c0f5b28f8 req-a10a2c2d-64f8-4604-b8b1-19df3ce35e34 tempest-SecurityGroupsTestJSON-1233321301 tempest-SecurityGroupsTestJSON-1233321301-project-member] Enqueued Resource ID: c35ef697-a559-4fc0-b340-e68ecaebccc7 with Priority: HIGHEST for action security_group_rules [ 895.772028] env[67094]: INFO networking_nsxv3.common.synchronization [req-c7efe786-cd3a-46ca-9a02-bb5c0f5b28f8 req-a10a2c2d-64f8-4604-b8b1-19df3ce35e34 tempest-SecurityGroupsTestJSON-1233321301 tempest-SecurityGroupsTestJSON-1233321301-project-member] Enqueued Resource ID: c35ef697-a559-4fc0-b340-e68ecaebccc7 with Priority: HIGHEST for action security_group_members [ 895.772028] env[67094]: INFO networking_nsxv3.common.synchronization [req-c7efe786-cd3a-46ca-9a02-bb5c0f5b28f8 req-a10a2c2d-64f8-4604-b8b1-19df3ce35e34 tempest-SecurityGroupsTestJSON-1233321301 tempest-SecurityGroupsTestJSON-1233321301-project-member] Enqueued Resource ID: f7861002-4b91-437c-8519-9140d1a3bd82 with Priority: HIGHEST for action security_group_rules [ 895.772028] env[67094]: INFO networking_nsxv3.common.synchronization [req-c7efe786-cd3a-46ca-9a02-bb5c0f5b28f8 req-a10a2c2d-64f8-4604-b8b1-19df3ce35e34 tempest-SecurityGroupsTestJSON-1233321301 tempest-SecurityGroupsTestJSON-1233321301-project-member] Enqueued Resource ID: f7861002-4b91-437c-8519-9140d1a3bd82 with Priority: HIGHEST for action security_group_members [ 895.772805] env[67094]: INFO networking_nsxv3.common.synchronization [req-c7efe786-cd3a-46ca-9a02-bb5c0f5b28f8 req-a10a2c2d-64f8-4604-b8b1-19df3ce35e34 tempest-SecurityGroupsTestJSON-1233321301 tempest-SecurityGroupsTestJSON-1233321301-project-member] Enqueued Resource ID: 4a2b9955-bb60-4627-a90f-504787008077 with Priority: HIGHEST for action port [ 895.774304] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a300461d-04cc-44a3-bc50-afbfc1076857 with Priority: HIGHEST for action security_group_rules [ 895.777122] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c35ef697-a559-4fc0-b340-e68ecaebccc7 with Priority: HIGHEST for action security_group_rules [ 895.777122] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7861002-4b91-437c-8519-9140d1a3bd82 with Priority: HIGHEST for action security_group_members [ 895.777122] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4a2b9955-bb60-4627-a90f-504787008077 with Priority: HIGHEST for action port [ 895.777122] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7861002-4b91-437c-8519-9140d1a3bd82 with Priority: HIGHEST for action security_group_rules [ 895.777122] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a300461d-04cc-44a3-bc50-afbfc1076857 with Priority: HIGHEST for action security_group_members [ 895.777122] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c35ef697-a559-4fc0-b340-e68ecaebccc7 with Priority: HIGHEST for action security_group_members [ 895.777122] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a300461d-04cc-44a3-bc50-afbfc1076857 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.777122] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a300461d-04cc-44a3-bc50-afbfc1076857" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.777122] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c35ef697-a559-4fc0-b340-e68ecaebccc7 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.777122] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c35ef697-a559-4fc0-b340-e68ecaebccc7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.780031] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c35ef697-a559-4fc0-b340-e68ecaebccc7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.780031] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c35ef697-a559-4fc0-b340-e68ecaebccc7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.780031] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c35ef697-a559-4fc0-b340-e68ecaebccc7',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.784025] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7861002-4b91-437c-8519-9140d1a3bd82 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.784025] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.784025] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-4a2b9955-bb60-4627-a90f-504787008077 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.784025] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-4a2b9955-bb60-4627-a90f-504787008077" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.784025] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-4a2b9955-bb60-4627-a90f-504787008077" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.784025] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-4a2b9955-bb60-4627-a90f-504787008077" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.784025] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('4a2b9955-bb60-4627-a90f-504787008077',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 895.786040] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f7861002-4b91-437c-8519-9140d1a3bd82 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.786275] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.786508] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-a300461d-04cc-44a3-bc50-afbfc1076857 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.789388] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a300461d-04cc-44a3-bc50-afbfc1076857" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.789388] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-c35ef697-a559-4fc0-b340-e68ecaebccc7 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.789388] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c35ef697-a559-4fc0-b340-e68ecaebccc7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.819679] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.819679] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.819679] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.819679] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.819679] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.819679] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ece2d85-d26d-4c59-ae47-b9a59cc4de8f is going to be created. [ 895.853639] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 895.853901] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 895.855036] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 895.855036] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 895.855036] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 895.872266] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ece2d85-d26d-4c59-ae47-b9a59cc4de8f in Status: UNINITIALIZED for 2s [ 896.098093] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4338a2b6-fa27-47ec-8f93-f4223c009203: rpc.has_security_group_logging(os_id): False [ 896.127813] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.128113] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.128315] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.128658] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.128850] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.129249] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.129450] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.129580] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.129919] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.130132] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.130335] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4338a2b6-fa27-47ec-8f93-f4223c009203 is going to be created. [ 896.190552] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f7861002-4b91-437c-8519-9140d1a3bd82',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.191265] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c35ef697-a559-4fc0-b340-e68ecaebccc7',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.192034] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a300461d-04cc-44a3-bc50-afbfc1076857',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.237429] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.237600] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.237656] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.237854] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.238237] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.260747] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4338a2b6-fa27-47ec-8f93-f4223c009203 in Status: IN_PROGRESS for 2s [ 896.289567] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-c35ef697-a559-4fc0-b340-e68ecaebccc7 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.289945] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c35ef697-a559-4fc0-b340-e68ecaebccc7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.290280] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 4a2b9955-bb60-4627-a90f-504787008077 with status ACTIVE [ 896.290530] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.290693] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.290801] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.291280] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.291355] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.291643] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.291845] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.291845] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.292228] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.292409] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.292748] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.292874] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.292946] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.293165] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.293463] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.293601] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 4a2b9955-bb60-4627-a90f-504787008077 is going to be updated. [ 896.565178] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 896.565178] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 896.565178] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 896.565178] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 896.565398] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.565437] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-4a2b9955-bb60-4627-a90f-504787008077" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 896.693055] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f7861002-4b91-437c-8519-9140d1a3bd82',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.695480] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c35ef697-a559-4fc0-b340-e68ecaebccc7',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 896.697907] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a300461d-04cc-44a3-bc50-afbfc1076857',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.115930] env[67094]: INFO networking_nsxv3.common.synchronization [req-f6655482-1380-447d-8e03-bdbb8933adfb req-e26cb4e4-de7a-4afd-9b77-8d81014aac14 tempest-ServersAdminTestJSON-236082081 tempest-ServersAdminTestJSON-236082081-project-member] Enqueued Resource ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f with Priority: HIGHEST for action security_group_members [ 897.116519] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f with Priority: HIGHEST for action security_group_members [ 897.116837] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f2ac94a-4beb-4e79-8490-47989224cf9f taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.116954] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.117200] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.117426] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.117586] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.117686] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.117751] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.117904] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.117992] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.118098] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f2ac94a-4beb-4e79-8490-47989224cf9f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.200259] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.200425] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.200491] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.200682] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.200768] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.200867] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7861002-4b91-437c-8519-9140d1a3bd82 is going to be updated. [ 897.203329] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.203329] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.203329] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.203329] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.203329] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.203329] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c35ef697-a559-4fc0-b340-e68ecaebccc7 is going to be created. [ 897.207488] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.207614] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.207683] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.207988] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.207988] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.208061] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a300461d-04cc-44a3-bc50-afbfc1076857 is going to be updated. [ 897.241783] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.241956] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.242038] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.242253] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.242418] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.247231] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.247231] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.247231] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.247231] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.247509] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.251667] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.251887] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.252017] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.252338] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.252572] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.258018] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c35ef697-a559-4fc0-b340-e68ecaebccc7 in Status: UNINITIALIZED for 2s [ 897.268901] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7861002-4b91-437c-8519-9140d1a3bd82 in Status: IN_PROGRESS for 2s [ 897.269677] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a300461d-04cc-44a3-bc50-afbfc1076857 in Status: IN_PROGRESS for 2s [ 897.393188] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a300461d-04cc-44a3-bc50-afbfc1076857 in Status: SUCCESS [ 897.393188] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a300461d-04cc-44a3-bc50-afbfc1076857" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.393188] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a300461d-04cc-44a3-bc50-afbfc1076857" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.393188] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a300461d-04cc-44a3-bc50-afbfc1076857" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.393188] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a300461d-04cc-44a3-bc50-afbfc1076857',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.402093] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7861002-4b91-437c-8519-9140d1a3bd82 in Status: SUCCESS [ 897.405677] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.405677] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.405677] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.405677] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f7861002-4b91-437c-8519-9140d1a3bd82',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.620938] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0f2ac94a-4beb-4e79-8490-47989224cf9f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.887143] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ece2d85-d26d-4c59-ae47-b9a59cc4de8f in Status: SUCCESS [ 897.887470] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ece2d85-d26d-4c59-ae47-b9a59cc4de8f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.888014] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ece2d85-d26d-4c59-ae47-b9a59cc4de8f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.888264] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ece2d85-d26d-4c59-ae47-b9a59cc4de8f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.888461] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.888575] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.889569] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 897.889569] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 897.889569] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.889569] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ece2d85-d26d-4c59-ae47-b9a59cc4de8f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 897.889569] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3ece2d85-d26d-4c59-ae47-b9a59cc4de8f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 897.895749] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-a300461d-04cc-44a3-bc50-afbfc1076857 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.895874] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a300461d-04cc-44a3-bc50-afbfc1076857" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 897.912838] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7861002-4b91-437c-8519-9140d1a3bd82 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 897.912980] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.123978] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0f2ac94a-4beb-4e79-8490-47989224cf9f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.278567] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4338a2b6-fa27-47ec-8f93-f4223c009203 in Status: SUCCESS [ 898.278999] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4338a2b6-fa27-47ec-8f93-f4223c009203" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.392507] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ece2d85-d26d-4c59-ae47-b9a59cc4de8f taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.392701] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ece2d85-d26d-4c59-ae47-b9a59cc4de8f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.393306] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ece2d85-d26d-4c59-ae47-b9a59cc4de8f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.393306] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ece2d85-d26d-4c59-ae47-b9a59cc4de8f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.393809] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.393809] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.393809] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.393955] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.393984] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.394406] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ece2d85-d26d-4c59-ae47-b9a59cc4de8f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.394406] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ece2d85-d26d-4c59-ae47-b9a59cc4de8f taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.394480] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ece2d85-d26d-4c59-ae47-b9a59cc4de8f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.394542] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ece2d85-d26d-4c59-ae47-b9a59cc4de8f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.394827] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ece2d85-d26d-4c59-ae47-b9a59cc4de8f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.394978] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.395087] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.395193] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.395348] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.395429] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.395513] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ece2d85-d26d-4c59-ae47-b9a59cc4de8f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.395606] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3ece2d85-d26d-4c59-ae47-b9a59cc4de8f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 898.628405] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.628552] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.628951] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.628951] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.629070] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.629160] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f is going to be updated. [ 898.664474] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.664634] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.664707] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.664916] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.665082] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.676626] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f in Status: IN_PROGRESS for 2s [ 898.904418] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3ece2d85-d26d-4c59-ae47-b9a59cc4de8f: rpc.has_security_group_logging(os_id): False [ 898.935593] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.935880] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.936011] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.936413] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.936552] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.936895] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.937631] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.938036] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.938145] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.938257] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.938856] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.939085] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.939238] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.939491] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.940358] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.940565] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 898.940565] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 898.941012] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 898.941232] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 898.941398] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 898.941544] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3ece2d85-d26d-4c59-ae47-b9a59cc4de8f is going to be created. [ 899.007299] env[67094]: INFO networking_nsxv3.common.synchronization [req-7d689ea8-f312-4382-9e09-f73da5f3c66d req-b011b49f-264b-48a9-8aaf-96712947d939 tempest-ServersNegativeTestJSON-136657224 tempest-ServersNegativeTestJSON-136657224-project-member] Enqueued Resource ID: 280210af-8e3d-42c9-8854-42bd856b9dbe with Priority: HIGHEST for action security_group_members [ 899.008027] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 280210af-8e3d-42c9-8854-42bd856b9dbe with Priority: HIGHEST for action security_group_members [ 899.008412] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-280210af-8e3d-42c9-8854-42bd856b9dbe taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.011714] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.011714] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.011714] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.011714] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.011714] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.011714] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.011714] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.011714] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.011714] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('280210af-8e3d-42c9-8854-42bd856b9dbe',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.011714] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.011714] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.011714] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.011714] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.012593] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.026149] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ece2d85-d26d-4c59-ae47-b9a59cc4de8f in Status: IN_PROGRESS for 2s [ 899.267637] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c35ef697-a559-4fc0-b340-e68ecaebccc7 in Status: SUCCESS [ 899.268099] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c35ef697-a559-4fc0-b340-e68ecaebccc7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.268099] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c35ef697-a559-4fc0-b340-e68ecaebccc7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.268401] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c35ef697-a559-4fc0-b340-e68ecaebccc7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.268462] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.268562] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.268630] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.268811] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.268899] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.268999] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c35ef697-a559-4fc0-b340-e68ecaebccc7',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.280981] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7861002-4b91-437c-8519-9140d1a3bd82 in Status: SUCCESS [ 899.281284] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.282137] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.282612] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.283032] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.283252] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.283369] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.283639] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.283785] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.283991] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7861002-4b91-437c-8519-9140d1a3bd82',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.286303] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a300461d-04cc-44a3-bc50-afbfc1076857 in Status: SUCCESS [ 899.287161] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a300461d-04cc-44a3-bc50-afbfc1076857" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.287161] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a300461d-04cc-44a3-bc50-afbfc1076857" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.287456] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a300461d-04cc-44a3-bc50-afbfc1076857" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.287731] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.287916] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.288031] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.288348] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.288449] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.288617] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a300461d-04cc-44a3-bc50-afbfc1076857',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.506794] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock network-120 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.507166] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "network-120" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.509616] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "network-120" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.509616] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "network-120" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.509616] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.509616] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.509616] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.509616] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.509616] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.509988] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 899.511693] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 899.511693] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 899.511693] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 899.511693] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 899.512021] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 899.512021] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 899.515652] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('280210af-8e3d-42c9-8854-42bd856b9dbe',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.536194] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 899.536413] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 899.536576] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 899.536833] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "network-120" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 899.540020] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock port-04573ffe-e0c5-40ae-9b7e-71f5cfe008a2 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.540020] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "port-04573ffe-e0c5-40ae-9b7e-71f5cfe008a2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.540020] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "port-04573ffe-e0c5-40ae-9b7e-71f5cfe008a2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 899.540020] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "port-04573ffe-e0c5-40ae-9b7e-71f5cfe008a2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 899.540020] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04573ffe-e0c5-40ae-9b7e-71f5cfe008a2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.772038] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c35ef697-a559-4fc0-b340-e68ecaebccc7',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.790735] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f7861002-4b91-437c-8519-9140d1a3bd82',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.792011] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a300461d-04cc-44a3-bc50-afbfc1076857',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 899.996842] env[67094]: INFO networking_nsxv3.common.synchronization [req-722f1d95-fc45-4abb-b6e3-6eb2e4d4685f req-2a4c05a6-3de9-43a2-9d92-c28b116d6ae0 tempest-SecurityGroupsTestJSON-1233321301 tempest-SecurityGroupsTestJSON-1233321301-project-member] Enqueued Resource ID: c35ef697-a559-4fc0-b340-e68ecaebccc7 with Priority: HIGHEST for action security_group_members [ 899.997020] env[67094]: INFO networking_nsxv3.common.synchronization [req-722f1d95-fc45-4abb-b6e3-6eb2e4d4685f req-2a4c05a6-3de9-43a2-9d92-c28b116d6ae0 tempest-SecurityGroupsTestJSON-1233321301 tempest-SecurityGroupsTestJSON-1233321301-project-member] Enqueued Resource ID: f7861002-4b91-437c-8519-9140d1a3bd82 with Priority: HIGHEST for action security_group_members [ 899.997153] env[67094]: INFO networking_nsxv3.common.synchronization [req-722f1d95-fc45-4abb-b6e3-6eb2e4d4685f req-2a4c05a6-3de9-43a2-9d92-c28b116d6ae0 tempest-SecurityGroupsTestJSON-1233321301 tempest-SecurityGroupsTestJSON-1233321301-project-member] Enqueued Resource ID: a300461d-04cc-44a3-bc50-afbfc1076857 with Priority: HIGHEST for action security_group_members [ 899.997666] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c35ef697-a559-4fc0-b340-e68ecaebccc7 with Priority: HIGHEST for action security_group_members [ 899.997803] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7861002-4b91-437c-8519-9140d1a3bd82 with Priority: HIGHEST for action security_group_members [ 899.997901] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a300461d-04cc-44a3-bc50-afbfc1076857 with Priority: HIGHEST for action security_group_members [ 899.998184] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-c35ef697-a559-4fc0-b340-e68ecaebccc7 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.998289] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c35ef697-a559-4fc0-b340-e68ecaebccc7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.998480] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7861002-4b91-437c-8519-9140d1a3bd82 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.998560] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 899.998783] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-a300461d-04cc-44a3-bc50-afbfc1076857 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 899.998919] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a300461d-04cc-44a3-bc50-afbfc1076857" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.018538] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('280210af-8e3d-42c9-8854-42bd856b9dbe',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.040505] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.040746] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.040965] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.041325] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.041489] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.041643] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Segment Port 04573ffe-e0c5-40ae-9b7e-71f5cfe008a2 not found, creating... [ 900.041911] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.042137] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.042234] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.042395] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.042530] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.042796] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.042946] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.043073] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.043275] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.043406] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.043542] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Resource: SegmentPort with ID: 04573ffe-e0c5-40ae-9b7e-71f5cfe008a2 is going to be created. [ 900.068013] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.068013] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.068013] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.068013] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.068013] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.068013] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "port-04573ffe-e0c5-40ae-9b7e-71f5cfe008a2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.274366] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c35ef697-a559-4fc0-b340-e68ecaebccc7',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.294171] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f7861002-4b91-437c-8519-9140d1a3bd82',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.297285] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a300461d-04cc-44a3-bc50-afbfc1076857',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.521976] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.522176] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.522239] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.522462] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.522551] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.522677] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 280210af-8e3d-42c9-8854-42bd856b9dbe is going to be updated. [ 900.556554] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.556705] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.556792] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.557063] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.557207] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.569504] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 280210af-8e3d-42c9-8854-42bd856b9dbe in Status: IN_PROGRESS for 2s [ 900.689049] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f in Status: SUCCESS [ 900.689257] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.777064] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.777702] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.777869] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.778362] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.778667] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.778667] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c35ef697-a559-4fc0-b340-e68ecaebccc7 is going to be updated. [ 900.796584] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.796765] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.796859] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.797183] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.797320] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.797428] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7861002-4b91-437c-8519-9140d1a3bd82 is going to be updated. [ 900.798904] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.799076] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.799155] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.799411] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.799505] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.799640] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a300461d-04cc-44a3-bc50-afbfc1076857 is going to be updated. [ 900.815294] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.815496] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.815622] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.815899] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.816654] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.828163] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c35ef697-a559-4fc0-b340-e68ecaebccc7 in Status: IN_PROGRESS for 2s [ 900.831998] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.832226] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.832226] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.832428] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.832577] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.834619] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.834735] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.834792] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.837176] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.837176] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 900.847039] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a300461d-04cc-44a3-bc50-afbfc1076857 in Status: IN_PROGRESS for 2s [ 900.848126] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7861002-4b91-437c-8519-9140d1a3bd82 in Status: IN_PROGRESS for 2s [ 900.852167] env[67094]: INFO networking_nsxv3.common.synchronization [req-7d689ea8-f312-4382-9e09-f73da5f3c66d req-23e94b7a-2bf5-45ca-8535-957933bd7498 service nova] Enqueued Resource ID: 280210af-8e3d-42c9-8854-42bd856b9dbe with Priority: HIGHEST for action security_group_rules [ 900.852167] env[67094]: INFO networking_nsxv3.common.synchronization [req-7d689ea8-f312-4382-9e09-f73da5f3c66d req-23e94b7a-2bf5-45ca-8535-957933bd7498 service nova] Enqueued Resource ID: 280210af-8e3d-42c9-8854-42bd856b9dbe with Priority: HIGHEST for action security_group_members [ 900.852369] env[67094]: INFO networking_nsxv3.common.synchronization [req-7d689ea8-f312-4382-9e09-f73da5f3c66d req-23e94b7a-2bf5-45ca-8535-957933bd7498 service nova] Enqueued Resource ID: 04573ffe-e0c5-40ae-9b7e-71f5cfe008a2 with Priority: HIGHEST for action port [ 900.854096] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 280210af-8e3d-42c9-8854-42bd856b9dbe with Priority: HIGHEST for action security_group_rules [ 900.854096] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 280210af-8e3d-42c9-8854-42bd856b9dbe with Priority: HIGHEST for action security_group_members [ 900.854096] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04573ffe-e0c5-40ae-9b7e-71f5cfe008a2 with Priority: HIGHEST for action port [ 900.854096] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-280210af-8e3d-42c9-8854-42bd856b9dbe taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.854096] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.854096] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.854096] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.854096] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('280210af-8e3d-42c9-8854-42bd856b9dbe',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.855303] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-280210af-8e3d-42c9-8854-42bd856b9dbe taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.855892] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.856196] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-04573ffe-e0c5-40ae-9b7e-71f5cfe008a2 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.856497] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-04573ffe-e0c5-40ae-9b7e-71f5cfe008a2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.856497] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-04573ffe-e0c5-40ae-9b7e-71f5cfe008a2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.856971] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-04573ffe-e0c5-40ae-9b7e-71f5cfe008a2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.857042] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('04573ffe-e0c5-40ae-9b7e-71f5cfe008a2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 900.966268] env[67094]: INFO networking_nsxv3.common.synchronization [None req-419457f9-9202-48ff-82eb-fd445d1890a1 tempest-ServerRescueNegativeTestJSON-389115858 tempest-ServerRescueNegativeTestJSON-389115858-project-member] Enqueued Resource ID: b61bfa2d-4c26-4a49-a153-4a8fb6153ccd with Priority: HIGHEST for action security_group_rules [ 900.966268] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b61bfa2d-4c26-4a49-a153-4a8fb6153ccd with Priority: HIGHEST for action security_group_rules [ 900.966268] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b61bfa2d-4c26-4a49-a153-4a8fb6153ccd taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 900.966268] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b61bfa2d-4c26-4a49-a153-4a8fb6153ccd" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 900.966268] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b61bfa2d-4c26-4a49-a153-4a8fb6153ccd" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 900.966268] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b61bfa2d-4c26-4a49-a153-4a8fb6153ccd" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 900.967793] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b61bfa2d-4c26-4a49-a153-4a8fb6153ccd',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 901.045846] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ece2d85-d26d-4c59-ae47-b9a59cc4de8f in Status: SUCCESS [ 901.046081] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3ece2d85-d26d-4c59-ae47-b9a59cc4de8f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.076330] env[67094]: INFO networking_nsxv3.common.synchronization [None req-68e0d8f8-2fff-46b8-a8a2-84e8e7af2bab tempest-ServerRescueNegativeTestJSON-389115858 tempest-ServerRescueNegativeTestJSON-389115858-project-member] Enqueued Resource ID: b61bfa2d-4c26-4a49-a153-4a8fb6153ccd with Priority: HIGHEST for action security_group_rules [ 901.076861] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b61bfa2d-4c26-4a49-a153-4a8fb6153ccd with Priority: HIGHEST for action security_group_rules [ 901.077188] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b61bfa2d-4c26-4a49-a153-4a8fb6153ccd taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.077284] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b61bfa2d-4c26-4a49-a153-4a8fb6153ccd" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.361197] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-280210af-8e3d-42c9-8854-42bd856b9dbe taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.361197] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.361197] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 04573ffe-e0c5-40ae-9b7e-71f5cfe008a2 with status ACTIVE [ 901.361949] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.361949] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.361949] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.361949] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.361949] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.362224] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.362224] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.362302] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.362404] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.362535] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.362702] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.362835] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.362835] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.362976] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.363073] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.363140] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 04573ffe-e0c5-40ae-9b7e-71f5cfe008a2 is going to be updated. [ 901.390408] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.390568] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.390568] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.390752] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.391094] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.391240] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-04573ffe-e0c5-40ae-9b7e-71f5cfe008a2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.492797] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 901.492797] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 901.492797] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.493036] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.493036] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.493036] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b61bfa2d-4c26-4a49-a153-4a8fb6153ccd already deleted. [ 901.493158] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b61bfa2d-4c26-4a49-a153-4a8fb6153ccd" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 901.493271] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b61bfa2d-4c26-4a49-a153-4a8fb6153ccd" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 901.493433] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b61bfa2d-4c26-4a49-a153-4a8fb6153ccd" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 901.493519] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b61bfa2d-4c26-4a49-a153-4a8fb6153ccd',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.018363] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.018584] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.018810] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.018919] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.019035] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.019200] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b61bfa2d-4c26-4a49-a153-4a8fb6153ccd already deleted. [ 902.019280] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b61bfa2d-4c26-4a49-a153-4a8fb6153ccd" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.582819] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 280210af-8e3d-42c9-8854-42bd856b9dbe in Status: SUCCESS [ 902.583115] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.583264] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.583438] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.583631] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.583743] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.583806] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.583949] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.584037] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.584131] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('280210af-8e3d-42c9-8854-42bd856b9dbe',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.784930] env[67094]: INFO networking_nsxv3.common.synchronization [req-f3e3c50f-6f25-4def-b794-c9d9938e7ba9 req-0ffb377e-04cc-46a3-8350-99147e5f42f6 tempest-ServerDiskConfigTestJSON-51233165 tempest-ServerDiskConfigTestJSON-51233165-project-member] Enqueued Resource ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 with Priority: HIGHEST for action security_group_members [ 902.785694] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 with Priority: HIGHEST for action security_group_members [ 902.786156] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.786337] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.786443] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.786665] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.786823] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.786923] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.787767] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.787767] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.787767] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.787767] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.840444] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c35ef697-a559-4fc0-b340-e68ecaebccc7 in Status: SUCCESS [ 902.840827] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c35ef697-a559-4fc0-b340-e68ecaebccc7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.841864] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c35ef697-a559-4fc0-b340-e68ecaebccc7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.842216] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c35ef697-a559-4fc0-b340-e68ecaebccc7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.842926] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.842992] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.843274] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.844407] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.844605] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.844828] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c35ef697-a559-4fc0-b340-e68ecaebccc7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.845089] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c35ef697-a559-4fc0-b340-e68ecaebccc7',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.847007] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c35ef697-a559-4fc0-b340-e68ecaebccc7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.847346] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c35ef697-a559-4fc0-b340-e68ecaebccc7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.847714] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.848097] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.848097] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.848266] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.848431] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.848598] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c35ef697-a559-4fc0-b340-e68ecaebccc7',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.865215] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a300461d-04cc-44a3-bc50-afbfc1076857 in Status: SUCCESS [ 902.865215] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a300461d-04cc-44a3-bc50-afbfc1076857" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.865435] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a300461d-04cc-44a3-bc50-afbfc1076857" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.865538] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a300461d-04cc-44a3-bc50-afbfc1076857" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.865795] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.865953] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.866073] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.870261] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.870261] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.870261] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a300461d-04cc-44a3-bc50-afbfc1076857" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.870261] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a300461d-04cc-44a3-bc50-afbfc1076857',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.872972] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7861002-4b91-437c-8519-9140d1a3bd82 in Status: SUCCESS [ 902.872972] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.872972] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a300461d-04cc-44a3-bc50-afbfc1076857" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.872972] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a300461d-04cc-44a3-bc50-afbfc1076857" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.873220] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.873220] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.873299] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.875825] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.875825] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.875825] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a300461d-04cc-44a3-bc50-afbfc1076857',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.875825] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.875825] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.875825] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.875825] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.876259] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.876259] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.876259] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.876346] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.876500] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('f7861002-4b91-437c-8519-9140d1a3bd82',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 902.877810] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.878042] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.878269] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 902.878457] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 902.878552] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 902.878688] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 902.878803] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 902.878927] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7861002-4b91-437c-8519-9140d1a3bd82',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.087201] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('280210af-8e3d-42c9-8854-42bd856b9dbe',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.263631] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock network-723 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.263770] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "network-723" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.263919] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "network-723" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.264341] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "network-723" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.265118] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.265118] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.265118] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.265291] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.265291] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.265496] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 903.266386] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 903.266386] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 903.266386] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 903.266386] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 903.266386] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 903.266386] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 903.288898] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 903.289123] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 903.289254] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 903.289415] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "network-723" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.289753] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock port-8c39270e-9bd3-4a64-998f-f4102557400f taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.291325] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "port-8c39270e-9bd3-4a64-998f-f4102557400f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.291325] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "port-8c39270e-9bd3-4a64-998f-f4102557400f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.291325] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "port-8c39270e-9bd3-4a64-998f-f4102557400f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.291325] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c39270e-9bd3-4a64-998f-f4102557400f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.291642] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.291741] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.292048] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.292173] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.292264] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.292918] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.292918] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.292918] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.292918] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.292918] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.293409] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 is going to be updated. [ 903.343750] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.343944] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.344055] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.344268] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.344451] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.350890] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c35ef697-a559-4fc0-b340-e68ecaebccc7',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.354499] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.354499] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.354499] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.354499] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.354740] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.354917] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.355145] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.355224] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.356009] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.356009] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.356009] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c35ef697-a559-4fc0-b340-e68ecaebccc7 is going to be deleted. [ 903.357500] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 in Status: IN_PROGRESS for 2s [ 903.378114] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a300461d-04cc-44a3-bc50-afbfc1076857',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.379773] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.379904] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.380052] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.380339] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.381499] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.381499] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.381499] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.381745] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.381924] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.382117] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.382240] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a300461d-04cc-44a3-bc50-afbfc1076857 is going to be updated. [ 903.384761] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7861002-4b91-437c-8519-9140d1a3bd82 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.384761] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.384761] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('f7861002-4b91-437c-8519-9140d1a3bd82',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.388038] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.388038] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.388038] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.388038] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.388038] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.388038] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c35ef697-a559-4fc0-b340-e68ecaebccc7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.419509] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.419720] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.419720] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.420413] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.420413] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.432105] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a300461d-04cc-44a3-bc50-afbfc1076857 in Status: IN_PROGRESS for 2s [ 903.589483] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('280210af-8e3d-42c9-8854-42bd856b9dbe',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.795051] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.795278] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.795357] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.795727] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.795804] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.795920] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Segment Port 8c39270e-9bd3-4a64-998f-f4102557400f not found, creating... [ 903.796184] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.796342] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.796460] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.796676] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.796815] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.797101] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.797263] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.797379] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.797584] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.797718] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.797879] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Resource: SegmentPort with ID: 8c39270e-9bd3-4a64-998f-f4102557400f is going to be created. [ 903.819570] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.819927] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.820037] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.820312] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.820571] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.820804] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "port-8c39270e-9bd3-4a64-998f-f4102557400f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.854032] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c35ef697-a559-4fc0-b340-e68ecaebccc7: rpc.has_security_group_logging(os_id): False [ 903.883942] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a300461d-04cc-44a3-bc50-afbfc1076857: rpc.has_security_group_logging(os_id): False [ 903.888942] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('f7861002-4b91-437c-8519-9140d1a3bd82',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 903.894050] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.894050] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.894050] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.894199] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.895231] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.895231] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.895231] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.895231] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.895231] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.895231] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.895231] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c35ef697-a559-4fc0-b340-e68ecaebccc7 is going to be created. [ 903.929402] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.929561] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.929637] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.929929] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.929999] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.930249] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 903.930396] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 903.930470] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 903.930640] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 903.930714] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 903.930801] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a300461d-04cc-44a3-bc50-afbfc1076857 is going to be updated. [ 903.932438] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/c35ef697-a559-4fc0-b340-e68ecaebccc7], does not exist path=[/infra/domains/default/groups/c35ef697-a559-4fc0-b340-e68ecaebccc7]."\n}' [ 903.932574] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c35ef697-a559-4fc0-b340-e68ecaebccc7 failed to be updated, retrying after metadata refresh: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/c35ef697-a559-4fc0-b340-e68ecaebccc7 [ 903.932655] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 904.015817] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.016019] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.016112] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.016330] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.017750] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.018117] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.018244] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.018309] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.018509] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.018636] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.018963] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.019086] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.019154] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.019320] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.019401] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.019489] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c35ef697-a559-4fc0-b340-e68ecaebccc7 is going to be created. [ 904.043841] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.044022] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.044086] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.044314] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.044434] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.051242] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.client_nsx [-] Warning Code=404 Message=b'{\n "httpStatus" : "NOT_FOUND",\n "error_code" : 500232,\n "module_name" : "Policy",\n "error_message" : "Following dependent objects, used in path=[/infra/domains/default/security-policies/c35ef697-a559-4fc0-b340-e68ecaebccc7], does not exist path=[/infra/domains/default/groups/c35ef697-a559-4fc0-b340-e68ecaebccc7]."\n}': requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/c35ef697-a559-4fc0-b340-e68ecaebccc7 [ 904.051436] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c35ef697-a559-4fc0-b340-e68ecaebccc7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.051703] env[67094]: Traceback (most recent call last): [ 904.051740] env[67094]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 36, in wrapper [ 904.051740] env[67094]: return func(*args, **kwargs) [ 904.051740] env[67094]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 904.051740] env[67094]: res.raise_for_status() [ 904.051740] env[67094]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 904.051740] env[67094]: raise HTTPError(http_error_msg, response=self) [ 904.051740] env[67094]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/c35ef697-a559-4fc0-b340-e68ecaebccc7 [ 904.051740] env[67094]: During handling of the above exception, another exception occurred: [ 904.051740] env[67094]: Traceback (most recent call last): [ 904.052077] env[67094]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/poll.py", line 111, in wait [ 904.052077] env[67094]: listener.cb(fileno) [ 904.052077] env[67094]: File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/greenthread.py", line 272, in main [ 904.052077] env[67094]: result = function(*args, **kwargs) [ 904.052077] env[67094]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/realization.py", line 210, in security_group_rules [ 904.052077] env[67094]: self.nsx_provider.sg_rules_realize(os_sg, logged=logged) [ 904.052077] env[67094]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 1012, in sg_rules_realize [ 904.052077] env[67094]: return self._realize(Provider.SG_RULES, delete, self.payload.sg_rules_container, os_sg, provider_sg) [ 904.052077] env[67094]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 45, in wrapper [ 904.052077] env[67094]: return func(self, resource_type, delete, self.payload.sg_rules_container, os_obj, provider_sg) [ 904.052077] env[67094]: File "/opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py", line 786, in _realize [ 904.052077] env[67094]: res.raise_for_status() [ 904.052077] env[67094]: File "/opt/stack/data/venv/lib/python3.10/site-packages/requests/models.py", line 1026, in raise_for_status [ 904.052077] env[67094]: raise HTTPError(http_error_msg, response=self) [ 904.052077] env[67094]: requests.exceptions.HTTPError: 404 Client Error: Not Found for url: https://nsxt.osci.c.eu-de-1.cloud.sap:443/policy/api/v1/infra/domains/default/security-policies/c35ef697-a559-4fc0-b340-e68ecaebccc7 [ 904.052077] env[67094]: Removing descriptor: 63 [ 904.061347] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a300461d-04cc-44a3-bc50-afbfc1076857 in Status: IN_PROGRESS for 2s [ 904.094823] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.095194] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.095306] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.095644] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.095798] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.095975] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 280210af-8e3d-42c9-8854-42bd856b9dbe is going to be updated. [ 904.129442] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.129590] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.129653] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.129900] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.130069] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.368988] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 280210af-8e3d-42c9-8854-42bd856b9dbe in Status: IN_PROGRESS for 2s [ 904.393969] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.394162] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.394416] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.394500] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.394580] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.397056] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7861002-4b91-437c-8519-9140d1a3bd82 is going to be updated. [ 904.437935] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.438102] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.438238] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.438387] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.438531] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 904.450301] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7861002-4b91-437c-8519-9140d1a3bd82 in Status: IN_PROGRESS for 2s [ 904.720332] env[67094]: INFO networking_nsxv3.common.synchronization [req-f3e3c50f-6f25-4def-b794-c9d9938e7ba9 req-372e87ba-367a-4533-b4cb-e1248cdbe44b service nova] Enqueued Resource ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 with Priority: HIGHEST for action security_group_rules [ 904.720614] env[67094]: INFO networking_nsxv3.common.synchronization [req-f3e3c50f-6f25-4def-b794-c9d9938e7ba9 req-372e87ba-367a-4533-b4cb-e1248cdbe44b service nova] Enqueued Resource ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 with Priority: HIGHEST for action security_group_members [ 904.720690] env[67094]: INFO networking_nsxv3.common.synchronization [req-f3e3c50f-6f25-4def-b794-c9d9938e7ba9 req-372e87ba-367a-4533-b4cb-e1248cdbe44b service nova] Enqueued Resource ID: 8c39270e-9bd3-4a64-998f-f4102557400f with Priority: HIGHEST for action port [ 904.724227] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 with Priority: HIGHEST for action security_group_rules [ 904.724227] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 with Priority: HIGHEST for action security_group_members [ 904.724227] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c39270e-9bd3-4a64-998f-f4102557400f with Priority: HIGHEST for action port [ 904.724227] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.724227] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.724227] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.724227] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.724227] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 904.726608] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.726608] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.726608] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-8c39270e-9bd3-4a64-998f-f4102557400f taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 904.726608] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8c39270e-9bd3-4a64-998f-f4102557400f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 904.727069] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8c39270e-9bd3-4a64-998f-f4102557400f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 904.727069] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8c39270e-9bd3-4a64-998f-f4102557400f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 904.727069] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8c39270e-9bd3-4a64-998f-f4102557400f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.228512] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.228666] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.228908] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8c39270e-9bd3-4a64-998f-f4102557400f with status ACTIVE [ 905.229097] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.229225] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.229323] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.229539] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.229632] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.229819] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.229926] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.229984] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.230149] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.230227] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.230411] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.230504] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.230559] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.230695] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.230764] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.230844] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8c39270e-9bd3-4a64-998f-f4102557400f is going to be updated. [ 905.371318] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 in Status: SUCCESS [ 905.371520] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 deletion is rescheduled due to dependency. [ 905.371584] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.371754] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.372022] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.373024] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.373024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.373024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.373024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.373024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.373024] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.377074] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.377251] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.377398] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.377522] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.377681] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.377845] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8c39270e-9bd3-4a64-998f-f4102557400f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.451740] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a300461d-04cc-44a3-bc50-afbfc1076857 in Status: SUCCESS [ 905.451901] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a300461d-04cc-44a3-bc50-afbfc1076857 deletion is rescheduled due to dependency. [ 905.451987] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a300461d-04cc-44a3-bc50-afbfc1076857" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.489205] env[67094]: INFO networking_nsxv3.common.synchronization [req-a793bf48-fabd-4c8f-bcde-7ac0f297d603 req-8b686e84-7ebe-4edc-a712-e8067a4beda7 tempest-ServerActionsV293TestJSON-121023143 tempest-ServerActionsV293TestJSON-121023143-project-member] Enqueued Resource ID: 7ec28241-1cbc-4bfa-acfa-d9a84a1a6dae with Priority: HIGHEST for action security_group_members [ 905.490031] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7ec28241-1cbc-4bfa-acfa-d9a84a1a6dae with Priority: HIGHEST for action security_group_members [ 905.490194] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-7ec28241-1cbc-4bfa-acfa-d9a84a1a6dae taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.490419] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7ec28241-1cbc-4bfa-acfa-d9a84a1a6dae" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.490501] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7ec28241-1cbc-4bfa-acfa-d9a84a1a6dae" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.490773] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7ec28241-1cbc-4bfa-acfa-d9a84a1a6dae" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.490951] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.491082] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.491148] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.491383] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 905.491527] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 905.491640] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7ec28241-1cbc-4bfa-acfa-d9a84a1a6dae',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.875393] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 905.994586] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 905.995463] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 905.995558] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 905.995789] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.019275] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.019275] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.019275] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.019275] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.019560] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.019560] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.019628] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ec28241-1cbc-4bfa-acfa-d9a84a1a6dae is going to be updated. [ 906.055105] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.055105] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.055105] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.055105] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.055105] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.064465] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ec28241-1cbc-4bfa-acfa-d9a84a1a6dae in Status: IN_PROGRESS for 2s [ 906.080692] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a300461d-04cc-44a3-bc50-afbfc1076857 in Status: SUCCESS [ 906.080778] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a300461d-04cc-44a3-bc50-afbfc1076857" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.380487] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 280210af-8e3d-42c9-8854-42bd856b9dbe in Status: SUCCESS [ 906.380690] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.380973] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.381942] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.382202] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.382999] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.382999] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.382999] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.382999] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.382999] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.382999] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.382999] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('280210af-8e3d-42c9-8854-42bd856b9dbe',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.462947] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7861002-4b91-437c-8519-9140d1a3bd82 in Status: SUCCESS [ 906.463266] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.463491] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.463785] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.464057] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.464227] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.464332] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.464550] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.465230] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.465230] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.465230] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7861002-4b91-437c-8519-9140d1a3bd82 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.465230] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.465230] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.465503] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.465533] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.465656] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.465736] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.465913] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.466016] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.466153] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.466255] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('f7861002-4b91-437c-8519-9140d1a3bd82',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.884806] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.885163] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.885163] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.885372] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.885372] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.885430] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 is going to be updated. [ 906.886873] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-280210af-8e3d-42c9-8854-42bd856b9dbe taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.886989] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.887034] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.887204] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.887367] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.888100] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.888100] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.888100] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.888100] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.888100] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.888100] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-280210af-8e3d-42c9-8854-42bd856b9dbe taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.888100] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.888100] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.888368] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.888368] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.888440] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.888440] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.888570] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.888662] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.888715] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.888932] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('280210af-8e3d-42c9-8854-42bd856b9dbe',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 906.926424] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.926680] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.926736] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.927047] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 906.927267] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 906.944311] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 in Status: IN_PROGRESS for 2s [ 906.968634] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for f7861002-4b91-437c-8519-9140d1a3bd82: rpc.has_security_group_logging(os_id): False [ 906.990233] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 906.991012] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 906.991012] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 906.991012] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.031987] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.032321] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.032440] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.032503] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.032715] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.032797] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.032991] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.033232] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.033232] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.033314] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.033372] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.033549] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.033636] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.033694] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.033832] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.033913] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.033979] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f7861002-4b91-437c-8519-9140d1a3bd82 is going to be updated. [ 907.130441] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.130757] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.130757] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.130920] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.131090] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.151387] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7861002-4b91-437c-8519-9140d1a3bd82 in Status: IN_PROGRESS for 2s [ 907.602348] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 280210af-8e3d-42c9-8854-42bd856b9dbe: rpc.has_security_group_logging(os_id): False [ 907.636775] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.636972] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.638302] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.638578] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.665153] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.669585] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.669585] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.669585] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.669585] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.669585] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.669585] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.669585] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.669585] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.669585] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.669585] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.669585] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.669585] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.669585] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.669585] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.670710] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.670710] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 280210af-8e3d-42c9-8854-42bd856b9dbe is going to be updated. [ 907.738793] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 907.742227] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 907.742227] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 907.742227] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 907.742227] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 907.762022] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 280210af-8e3d-42c9-8854-42bd856b9dbe in Status: IN_PROGRESS for 2s [ 908.080164] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7ec28241-1cbc-4bfa-acfa-d9a84a1a6dae in Status: SUCCESS [ 908.080478] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7ec28241-1cbc-4bfa-acfa-d9a84a1a6dae deletion is rescheduled due to dependency. [ 908.080653] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7ec28241-1cbc-4bfa-acfa-d9a84a1a6dae" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.951863] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 in Status: SUCCESS [ 908.951863] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.952379] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.952379] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.952530] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 908.952590] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 908.952624] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 908.953050] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 908.953050] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.953050] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 908.953050] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.172355] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: f7861002-4b91-437c-8519-9140d1a3bd82 in Status: SUCCESS [ 909.172355] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.459025] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.459025] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.459025] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.459025] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.459025] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.459025] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.459025] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.459025] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.459025] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.459025] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.459025] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.459025] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.459025] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.459025] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.459025] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.459025] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.459977] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.460345] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.460566] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.462289] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.462289] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.712421] env[67094]: INFO networking_nsxv3.common.synchronization [req-5f5edab4-7d34-4ea9-96f0-22bdce9f26b4 req-04c71466-0a80-4045-9292-86b017b9f7dd tempest-ImagesTestJSON-2097058733 tempest-ImagesTestJSON-2097058733-project-member] Enqueued Resource ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa with Priority: HIGHEST for action security_group_members [ 909.712964] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa with Priority: HIGHEST for action security_group_members [ 909.713420] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-84918628-8f8e-4d25-9c0f-17cccb58ebfa taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.713420] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.713544] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.713696] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.714594] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.714594] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.714594] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.714594] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 909.714594] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.714594] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('84918628-8f8e-4d25-9c0f-17cccb58ebfa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 909.778608] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 280210af-8e3d-42c9-8854-42bd856b9dbe in Status: SUCCESS [ 909.779150] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 909.964762] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6: rpc.has_security_group_logging(os_id): False [ 909.985560] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 909.985713] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 909.985811] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 909.986231] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.010959] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.011441] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.011513] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.011549] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.011757] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.011886] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.012157] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.012277] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.012346] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.012503] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.012581] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.012779] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.012876] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.012955] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.013134] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.013211] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.013297] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 is going to be updated. [ 910.077308] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.077525] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.077525] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.077731] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.077880] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.094459] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 in Status: IN_PROGRESS for 2s [ 910.218694] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.219094] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.219094] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.219344] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.242055] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.243047] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.243047] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.243047] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.243047] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.243047] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.243047] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa is going to be updated. [ 910.273034] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 910.273798] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 910.273798] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 910.273798] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 910.273798] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 910.285008] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa in Status: IN_PROGRESS for 2s [ 911.395360] env[67094]: INFO networking_nsxv3.common.synchronization [None req-4fdb041e-6d52-4786-9786-2fc323e0681f tempest-AttachVolumeTestJSON-829034394 tempest-AttachVolumeTestJSON-829034394-project-member] Enqueued Resource ID: 529c6563-9354-49e2-8282-acd28e0b0ef7 with Priority: HIGHEST for action security_group_rules [ 911.398499] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 529c6563-9354-49e2-8282-acd28e0b0ef7 with Priority: HIGHEST for action security_group_rules [ 911.398499] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-529c6563-9354-49e2-8282-acd28e0b0ef7 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.398499] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-529c6563-9354-49e2-8282-acd28e0b0ef7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.398499] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-529c6563-9354-49e2-8282-acd28e0b0ef7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.398499] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-529c6563-9354-49e2-8282-acd28e0b0ef7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.398499] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('529c6563-9354-49e2-8282-acd28e0b0ef7',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.505713] env[67094]: INFO networking_nsxv3.common.synchronization [None req-df95cd99-2bc1-40e6-901b-5ed3ba7ea06b None None] Enqueued Resource ID: ab7881d3-7086-4deb-9d08-acf22201e13f with Priority: HIGHEST for action port [ 911.508070] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ab7881d3-7086-4deb-9d08-acf22201e13f with Priority: HIGHEST for action port [ 911.508070] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-ab7881d3-7086-4deb-9d08-acf22201e13f taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.508070] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ab7881d3-7086-4deb-9d08-acf22201e13f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.508070] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ab7881d3-7086-4deb-9d08-acf22201e13f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.510487] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ab7881d3-7086-4deb-9d08-acf22201e13f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.510487] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ab7881d3-7086-4deb-9d08-acf22201e13f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 911.530854] env[67094]: INFO networking_nsxv3.common.synchronization [None req-d89471e4-ee3e-4a33-b301-393cd30fdb79 tempest-AttachVolumeTestJSON-829034394 tempest-AttachVolumeTestJSON-829034394-project-member] Enqueued Resource ID: 529c6563-9354-49e2-8282-acd28e0b0ef7 with Priority: HIGHEST for action security_group_rules [ 911.531395] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 529c6563-9354-49e2-8282-acd28e0b0ef7 with Priority: HIGHEST for action security_group_rules [ 911.531759] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-529c6563-9354-49e2-8282-acd28e0b0ef7 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.531841] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-529c6563-9354-49e2-8282-acd28e0b0ef7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.921446] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 911.921446] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 911.921446] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.921446] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.921446] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.921446] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 529c6563-9354-49e2-8282-acd28e0b0ef7 already deleted. [ 911.921446] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-529c6563-9354-49e2-8282-acd28e0b0ef7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 911.921817] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-529c6563-9354-49e2-8282-acd28e0b0ef7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 911.921817] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-529c6563-9354-49e2-8282-acd28e0b0ef7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 911.921817] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('529c6563-9354-49e2-8282-acd28e0b0ef7',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 912.012341] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ab7881d3-7086-4deb-9d08-acf22201e13f [ 912.012341] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.012341] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.012341] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.013536] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.013536] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.013536] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ab7881d3-7086-4deb-9d08-acf22201e13f already deleted. [ 912.013536] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ab7881d3-7086-4deb-9d08-acf22201e13f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.115900] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 in Status: SUCCESS [ 912.116336] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.303404] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa in Status: SUCCESS [ 912.303712] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa deletion is rescheduled due to dependency. [ 912.303919] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.445208] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 912.445617] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 912.445617] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 912.445711] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 912.445793] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 912.445832] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 529c6563-9354-49e2-8282-acd28e0b0ef7 already deleted. [ 912.445908] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-529c6563-9354-49e2-8282-acd28e0b0ef7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.453893] env[67094]: INFO networking_nsxv3.common.synchronization [req-389db56a-5c1e-4162-9a34-4b6b581a5cc6 req-ba99ddf4-d761-42a5-a262-0b3083762efa tempest-ServersNegativeTestJSON-136657224 tempest-ServersNegativeTestJSON-136657224-project-member] Enqueued Resource ID: 280210af-8e3d-42c9-8854-42bd856b9dbe with Priority: HIGHEST for action security_group_members [ 913.454816] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 280210af-8e3d-42c9-8854-42bd856b9dbe with Priority: HIGHEST for action security_group_members [ 913.454816] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-280210af-8e3d-42c9-8854-42bd856b9dbe taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.454966] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.455010] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.456314] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.456734] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 913.457750] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 913.457750] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 913.457750] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 913.457750] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 913.457750] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('280210af-8e3d-42c9-8854-42bd856b9dbe',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 913.959783] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('280210af-8e3d-42c9-8854-42bd856b9dbe',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.463476] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('280210af-8e3d-42c9-8854-42bd856b9dbe',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 914.965975] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 914.966150] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 914.966242] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 914.966730] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 914.966730] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 914.966730] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 280210af-8e3d-42c9-8854-42bd856b9dbe is going to be updated. [ 915.000847] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.000984] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.001068] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.001278] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.001421] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.011229] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 280210af-8e3d-42c9-8854-42bd856b9dbe in Status: IN_PROGRESS for 2s [ 915.071882] env[67094]: INFO networking_nsxv3.common.synchronization [None req-907c3131-059e-440d-b130-60226aef6b4c None None] Enqueued Resource ID: f77140ce-186d-45b8-9f8f-12606e4feb08 with Priority: HIGHEST for action port [ 915.073646] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f77140ce-186d-45b8-9f8f-12606e4feb08 with Priority: HIGHEST for action port [ 915.073646] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-f77140ce-186d-45b8-9f8f-12606e4feb08 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.073646] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-f77140ce-186d-45b8-9f8f-12606e4feb08" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.073646] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-f77140ce-186d-45b8-9f8f-12606e4feb08" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.074544] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-f77140ce-186d-45b8-9f8f-12606e4feb08" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.074650] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('f77140ce-186d-45b8-9f8f-12606e4feb08',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.200330] env[67094]: INFO networking_nsxv3.common.synchronization [None req-38951fdd-5b42-4de6-b644-278822eef39b None None] Enqueued Resource ID: 35ffe438-c9aa-48a1-ac1f-60bd4f8cce01 with Priority: HIGHEST for action port [ 915.200423] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 35ffe438-c9aa-48a1-ac1f-60bd4f8cce01 with Priority: HIGHEST for action port [ 915.200870] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-35ffe438-c9aa-48a1-ac1f-60bd4f8cce01 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.200870] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-35ffe438-c9aa-48a1-ac1f-60bd4f8cce01" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.200870] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-35ffe438-c9aa-48a1-ac1f-60bd4f8cce01" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.201789] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-35ffe438-c9aa-48a1-ac1f-60bd4f8cce01" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.202138] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('35ffe438-c9aa-48a1-ac1f-60bd4f8cce01',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 915.579549] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port f77140ce-186d-45b8-9f8f-12606e4feb08 [ 915.579776] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.579978] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.581833] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.581833] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.581833] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.581833] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:f77140ce-186d-45b8-9f8f-12606e4feb08 already deleted. [ 915.581833] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-f77140ce-186d-45b8-9f8f-12606e4feb08" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.704520] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 35ffe438-c9aa-48a1-ac1f-60bd4f8cce01 [ 915.704861] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 915.705163] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 915.705255] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 915.705526] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 915.705662] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 915.705766] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:35ffe438-c9aa-48a1-ac1f-60bd4f8cce01 already deleted. [ 915.705854] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-35ffe438-c9aa-48a1-ac1f-60bd4f8cce01" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.024961] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 280210af-8e3d-42c9-8854-42bd856b9dbe in Status: SUCCESS [ 917.024961] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.605597] env[67094]: INFO networking_nsxv3.common.synchronization [req-4130835a-16af-465e-a7dc-4736f77b3fa8 req-57e9a836-28ea-4f92-bb77-151853010063 tempest-MigrationsAdminTest-1501090521 tempest-MigrationsAdminTest-1501090521-project-member] Enqueued Resource ID: fbf0de02-2c4b-4156-ae88-4a3e624f550d with Priority: HIGHEST for action security_group_members [ 917.605597] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fbf0de02-2c4b-4156-ae88-4a3e624f550d with Priority: HIGHEST for action security_group_members [ 917.605597] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-fbf0de02-2c4b-4156-ae88-4a3e624f550d taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.607048] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fbf0de02-2c4b-4156-ae88-4a3e624f550d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.607139] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fbf0de02-2c4b-4156-ae88-4a3e624f550d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.607349] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fbf0de02-2c4b-4156-ae88-4a3e624f550d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.607565] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 917.607684] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 917.607767] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 917.607964] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 917.608068] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 917.608153] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fbf0de02-2c4b-4156-ae88-4a3e624f550d',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 918.112287] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.112287] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.112287] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.112708] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.135805] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.136105] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.136244] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.136311] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.136512] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.137453] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.137453] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fbf0de02-2c4b-4156-ae88-4a3e624f550d is going to be updated. [ 918.165625] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 918.165835] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 918.165835] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 918.166395] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 918.166558] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 918.178043] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fbf0de02-2c4b-4156-ae88-4a3e624f550d in Status: IN_PROGRESS for 2s [ 919.342548] env[67094]: INFO networking_nsxv3.common.synchronization [None req-9193cc5e-f4d1-48f3-b021-0c29bccb2255 None None] Enqueued Resource ID: ad4be864-a6f0-4dfc-8491-4f4749f949f0 with Priority: HIGHEST for action port [ 919.343206] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ad4be864-a6f0-4dfc-8491-4f4749f949f0 with Priority: HIGHEST for action port [ 919.343491] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-ad4be864-a6f0-4dfc-8491-4f4749f949f0 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.343617] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ad4be864-a6f0-4dfc-8491-4f4749f949f0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.343686] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ad4be864-a6f0-4dfc-8491-4f4749f949f0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.343940] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ad4be864-a6f0-4dfc-8491-4f4749f949f0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.344050] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ad4be864-a6f0-4dfc-8491-4f4749f949f0',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 919.847090] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ad4be864-a6f0-4dfc-8491-4f4749f949f0 [ 919.848499] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 919.848499] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 919.848499] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 919.848499] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 919.848499] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 919.848499] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ad4be864-a6f0-4dfc-8491-4f4749f949f0 already deleted. [ 919.848499] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ad4be864-a6f0-4dfc-8491-4f4749f949f0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.072414] env[67094]: INFO networking_nsxv3.common.synchronization [None req-7bf4eb4c-d6f8-47a9-862f-f4dedac18e37 tempest-ServerActionsTestJSON-785713127 tempest-ServerActionsTestJSON-785713127-project-member] Enqueued Resource ID: 5d6b6e19-f017-4eac-b0ac-ed1b17230d12 with Priority: HIGHEST for action security_group_rules [ 920.073922] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d6b6e19-f017-4eac-b0ac-ed1b17230d12 with Priority: HIGHEST for action security_group_rules [ 920.074634] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5d6b6e19-f017-4eac-b0ac-ed1b17230d12 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.074760] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5d6b6e19-f017-4eac-b0ac-ed1b17230d12" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.074826] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5d6b6e19-f017-4eac-b0ac-ed1b17230d12" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.075143] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5d6b6e19-f017-4eac-b0ac-ed1b17230d12" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.075206] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5d6b6e19-f017-4eac-b0ac-ed1b17230d12',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 920.162030] env[67094]: INFO networking_nsxv3.common.synchronization [None req-22c3cd6c-c3fa-416b-8063-2b4a30f091b3 tempest-ServerActionsTestJSON-785713127 tempest-ServerActionsTestJSON-785713127-project-member] Enqueued Resource ID: 5d6b6e19-f017-4eac-b0ac-ed1b17230d12 with Priority: HIGHEST for action security_group_rules [ 920.162213] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d6b6e19-f017-4eac-b0ac-ed1b17230d12 with Priority: HIGHEST for action security_group_rules [ 920.164457] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5d6b6e19-f017-4eac-b0ac-ed1b17230d12 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.164457] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5d6b6e19-f017-4eac-b0ac-ed1b17230d12" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.188704] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fbf0de02-2c4b-4156-ae88-4a3e624f550d in Status: SUCCESS [ 920.188899] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fbf0de02-2c4b-4156-ae88-4a3e624f550d deletion is rescheduled due to dependency. [ 920.191962] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fbf0de02-2c4b-4156-ae88-4a3e624f550d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.613377] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 920.613778] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 920.613778] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.613999] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.614122] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.614224] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5d6b6e19-f017-4eac-b0ac-ed1b17230d12 already deleted. [ 920.614312] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5d6b6e19-f017-4eac-b0ac-ed1b17230d12" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 920.614822] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5d6b6e19-f017-4eac-b0ac-ed1b17230d12" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 920.615008] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5d6b6e19-f017-4eac-b0ac-ed1b17230d12" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 920.615226] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5d6b6e19-f017-4eac-b0ac-ed1b17230d12',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 921.206706] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 921.208047] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 921.208047] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 921.208047] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 921.208047] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 921.208047] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5d6b6e19-f017-4eac-b0ac-ed1b17230d12 already deleted. [ 921.208047] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5d6b6e19-f017-4eac-b0ac-ed1b17230d12" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.452768] env[67094]: INFO networking_nsxv3.common.synchronization [req-330a716d-3648-4304-9530-8733a13494e9 req-8b585c64-e9b0-4ee2-871a-7ce1877bb5ba tempest-ServersTestJSON-1070791530 tempest-ServersTestJSON-1070791530-project-member] Enqueued Resource ID: c0881101-1be1-4dbf-ac18-2d54a689202c with Priority: HIGHEST for action security_group_members [ 922.453391] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0881101-1be1-4dbf-ac18-2d54a689202c with Priority: HIGHEST for action security_group_members [ 922.453508] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0881101-1be1-4dbf-ac18-2d54a689202c taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.455318] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.455318] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.455318] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.455318] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.455318] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.455318] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.455318] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.455318] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.455318] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.874652] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock network-91 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.874940] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "network-91" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.875674] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "network-91" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.875674] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "network-91" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.875674] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.875674] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.875981] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.876225] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.876372] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.876586] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 922.876701] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 922.876821] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 922.877093] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 922.877371] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 922.877371] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 922.877499] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 922.897703] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 922.897703] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 922.897703] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 922.897703] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "network-91" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 922.897703] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock port-d42f0907-6610-4a3a-826e-27e00f78ea37 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 922.897703] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "port-d42f0907-6610-4a3a-826e-27e00f78ea37" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 922.897703] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "port-d42f0907-6610-4a3a-826e-27e00f78ea37" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 922.897977] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "port-d42f0907-6610-4a3a-826e-27e00f78ea37" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 922.898116] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d42f0907-6610-4a3a-826e-27e00f78ea37',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 922.957770] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.167160] env[67094]: INFO networking_nsxv3.common.synchronization [req-ecf7cef4-9602-4b0a-bde5-662a9472b6c5 req-c7a029b9-68e0-4e11-840c-4076378e6f78 tempest-ServersTestJSON-610582052 tempest-ServersTestJSON-610582052-project-member] Enqueued Resource ID: 2bc6c42e-23db-4008-8db7-e57d76593898 with Priority: HIGHEST for action security_group_members [ 923.168131] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bc6c42e-23db-4008-8db7-e57d76593898 with Priority: HIGHEST for action security_group_members [ 923.168469] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-2bc6c42e-23db-4008-8db7-e57d76593898 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.168633] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-2bc6c42e-23db-4008-8db7-e57d76593898" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.168726] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-2bc6c42e-23db-4008-8db7-e57d76593898" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.168942] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-2bc6c42e-23db-4008-8db7-e57d76593898" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.169097] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.169199] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.169273] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.169418] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.169508] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.169608] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('2bc6c42e-23db-4008-8db7-e57d76593898',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.401097] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.401097] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.401097] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.402049] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.402049] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.402049] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Segment Port d42f0907-6610-4a3a-826e-27e00f78ea37 not found, creating... [ 923.402202] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.402621] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.402621] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.402810] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.403223] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.403369] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.403865] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.403865] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.403865] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.404164] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.404164] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Resource: SegmentPort with ID: d42f0907-6610-4a3a-826e-27e00f78ea37 is going to be created. [ 923.428706] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.429016] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.429365] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.429506] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.429819] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.430103] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "port-d42f0907-6610-4a3a-826e-27e00f78ea37" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.460285] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 923.674516] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.674673] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.674778] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.675066] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.706804] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.707144] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.707272] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.707343] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.707558] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.707644] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.707737] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2bc6c42e-23db-4008-8db7-e57d76593898 is going to be updated. [ 923.741713] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.743090] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.743090] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.743090] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.743090] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.753930] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2bc6c42e-23db-4008-8db7-e57d76593898 in Status: IN_PROGRESS for 2s [ 923.966440] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 923.966440] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 923.966440] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 923.966440] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 923.966440] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 923.966440] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0881101-1be1-4dbf-ac18-2d54a689202c is going to be updated. [ 924.002294] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.002527] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.002527] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.002853] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.002853] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.015135] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0881101-1be1-4dbf-ac18-2d54a689202c in Status: IN_PROGRESS for 2s [ 924.206929] env[67094]: INFO networking_nsxv3.common.synchronization [req-330a716d-3648-4304-9530-8733a13494e9 req-20bd8f83-f74e-4bc1-bfb8-b5d32fa48596 service nova] Enqueued Resource ID: c0881101-1be1-4dbf-ac18-2d54a689202c with Priority: HIGHEST for action security_group_rules [ 924.207122] env[67094]: INFO networking_nsxv3.common.synchronization [req-330a716d-3648-4304-9530-8733a13494e9 req-20bd8f83-f74e-4bc1-bfb8-b5d32fa48596 service nova] Enqueued Resource ID: c0881101-1be1-4dbf-ac18-2d54a689202c with Priority: HIGHEST for action security_group_members [ 924.207293] env[67094]: INFO networking_nsxv3.common.synchronization [req-330a716d-3648-4304-9530-8733a13494e9 req-20bd8f83-f74e-4bc1-bfb8-b5d32fa48596 service nova] Enqueued Resource ID: d42f0907-6610-4a3a-826e-27e00f78ea37 with Priority: HIGHEST for action port [ 924.207783] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0881101-1be1-4dbf-ac18-2d54a689202c with Priority: HIGHEST for action security_group_rules [ 924.207921] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0881101-1be1-4dbf-ac18-2d54a689202c with Priority: HIGHEST for action security_group_members [ 924.208689] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d42f0907-6610-4a3a-826e-27e00f78ea37 with Priority: HIGHEST for action port [ 924.209128] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0881101-1be1-4dbf-ac18-2d54a689202c taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.209218] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.209218] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.209415] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.209494] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.210673] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0881101-1be1-4dbf-ac18-2d54a689202c taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.210789] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.212303] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-d42f0907-6610-4a3a-826e-27e00f78ea37 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.212496] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d42f0907-6610-4a3a-826e-27e00f78ea37" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.212496] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d42f0907-6610-4a3a-826e-27e00f78ea37" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.212680] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d42f0907-6610-4a3a-826e-27e00f78ea37" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.212810] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d42f0907-6610-4a3a-826e-27e00f78ea37',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 924.715757] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0881101-1be1-4dbf-ac18-2d54a689202c taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.715757] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.716161] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d42f0907-6610-4a3a-826e-27e00f78ea37 with status ACTIVE [ 924.716161] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.716161] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.716331] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.716413] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.716758] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.716758] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.716758] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.716966] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.717054] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.717132] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.717761] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.717761] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.717761] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.717761] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.717761] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.717761] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d42f0907-6610-4a3a-826e-27e00f78ea37 is going to be updated. [ 924.741305] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 924.741537] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 924.741579] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 924.741787] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 924.741943] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 924.742120] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d42f0907-6610-4a3a-826e-27e00f78ea37" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.029258] env[67094]: INFO networking_nsxv3.common.synchronization [req-b63c91f6-e868-4281-af01-2e57289452ae req-071d2f3b-b733-4f72-85d0-d5b85d2da56b tempest-AttachInterfacesV270Test-93374714 tempest-AttachInterfacesV270Test-93374714-project-member] Enqueued Resource ID: 9acaf46f-6800-4e8d-bec0-432525de6a87 with Priority: HIGHEST for action security_group_members [ 925.029867] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9acaf46f-6800-4e8d-bec0-432525de6a87 with Priority: HIGHEST for action security_group_members [ 925.030219] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-9acaf46f-6800-4e8d-bec0-432525de6a87 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.030343] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9acaf46f-6800-4e8d-bec0-432525de6a87" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.030411] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9acaf46f-6800-4e8d-bec0-432525de6a87" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.030719] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9acaf46f-6800-4e8d-bec0-432525de6a87" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.030877] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.030979] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.031644] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.032072] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.032196] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.032298] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9acaf46f-6800-4e8d-bec0-432525de6a87',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.378056] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock network-613 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.378280] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "network-613" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.378374] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "network-613" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.378709] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "network-613" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.379100] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.379369] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.379515] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.379708] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.380812] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.380812] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 925.380812] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 925.380812] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 925.380812] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 925.380812] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 925.380812] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 925.380812] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 925.407391] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 925.407458] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 925.407580] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 925.407755] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "network-613" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.408096] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock port-b7494c30-5ed8-4a79-be3b-149fbc4a6497 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.408275] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "port-b7494c30-5ed8-4a79-be3b-149fbc4a6497" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.408862] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "port-b7494c30-5ed8-4a79-be3b-149fbc4a6497" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.408862] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "port-b7494c30-5ed8-4a79-be3b-149fbc4a6497" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.408862] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7494c30-5ed8-4a79-be3b-149fbc4a6497',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 925.538421] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.538706] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.538895] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.539062] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.539187] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.539535] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.539535] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.539907] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.539907] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.539907] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.540159] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9acaf46f-6800-4e8d-bec0-432525de6a87 already deleted. [ 925.540159] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9acaf46f-6800-4e8d-bec0-432525de6a87" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.778112] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 2bc6c42e-23db-4008-8db7-e57d76593898 in Status: SUCCESS [ 925.778469] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 2bc6c42e-23db-4008-8db7-e57d76593898 deletion is rescheduled due to dependency. [ 925.778469] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-2bc6c42e-23db-4008-8db7-e57d76593898" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.953019] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.953019] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.953019] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.953019] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.953019] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.953019] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Segment Port b7494c30-5ed8-4a79-be3b-149fbc4a6497 not found, creating... [ 925.953647] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.953647] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.953647] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.956331] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.956331] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.956331] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.956331] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.956331] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.956331] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.956331] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.956331] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Resource: SegmentPort with ID: b7494c30-5ed8-4a79-be3b-149fbc4a6497 is going to be created. [ 925.981979] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 925.982418] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 925.982505] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 925.982909] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 925.983355] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 925.983625] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "port-b7494c30-5ed8-4a79-be3b-149fbc4a6497" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.029186] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0881101-1be1-4dbf-ac18-2d54a689202c in Status: SUCCESS [ 926.029525] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.029735] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.030020] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.030318] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.030452] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.030519] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.030727] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.030852] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.031014] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.536556] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.777408] env[67094]: INFO networking_nsxv3.common.synchronization [req-b63c91f6-e868-4281-af01-2e57289452ae req-73e26697-b649-4a2a-9ba9-70004a544c07 service nova] Enqueued Resource ID: 9acaf46f-6800-4e8d-bec0-432525de6a87 with Priority: HIGHEST for action security_group_rules [ 926.777589] env[67094]: INFO networking_nsxv3.common.synchronization [req-b63c91f6-e868-4281-af01-2e57289452ae req-73e26697-b649-4a2a-9ba9-70004a544c07 service nova] Enqueued Resource ID: 9acaf46f-6800-4e8d-bec0-432525de6a87 with Priority: HIGHEST for action security_group_members [ 926.779706] env[67094]: INFO networking_nsxv3.common.synchronization [req-b63c91f6-e868-4281-af01-2e57289452ae req-73e26697-b649-4a2a-9ba9-70004a544c07 service nova] Enqueued Resource ID: b7494c30-5ed8-4a79-be3b-149fbc4a6497 with Priority: HIGHEST for action port [ 926.779706] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9acaf46f-6800-4e8d-bec0-432525de6a87 with Priority: HIGHEST for action security_group_rules [ 926.779706] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9acaf46f-6800-4e8d-bec0-432525de6a87 with Priority: HIGHEST for action security_group_members [ 926.779706] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b7494c30-5ed8-4a79-be3b-149fbc4a6497 with Priority: HIGHEST for action port [ 926.779706] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9acaf46f-6800-4e8d-bec0-432525de6a87 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.779706] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9acaf46f-6800-4e8d-bec0-432525de6a87" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.779706] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9acaf46f-6800-4e8d-bec0-432525de6a87" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.779706] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9acaf46f-6800-4e8d-bec0-432525de6a87" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.779706] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9acaf46f-6800-4e8d-bec0-432525de6a87',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.780491] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-9acaf46f-6800-4e8d-bec0-432525de6a87 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.780491] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9acaf46f-6800-4e8d-bec0-432525de6a87" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.780491] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9acaf46f-6800-4e8d-bec0-432525de6a87" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.780603] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9acaf46f-6800-4e8d-bec0-432525de6a87" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.780648] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.780739] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.780795] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.780937] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.781035] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 926.781115] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9acaf46f-6800-4e8d-bec0-432525de6a87',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 926.781934] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-b7494c30-5ed8-4a79-be3b-149fbc4a6497 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 926.782904] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b7494c30-5ed8-4a79-be3b-149fbc4a6497" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 926.784053] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b7494c30-5ed8-4a79-be3b-149fbc4a6497" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 926.784053] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b7494c30-5ed8-4a79-be3b-149fbc4a6497" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 926.784053] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b7494c30-5ed8-4a79-be3b-149fbc4a6497',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.041488] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.286524] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-9acaf46f-6800-4e8d-bec0-432525de6a87 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.286673] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9acaf46f-6800-4e8d-bec0-432525de6a87" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.286900] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('9acaf46f-6800-4e8d-bec0-432525de6a87',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 927.287773] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b7494c30-5ed8-4a79-be3b-149fbc4a6497 with status ACTIVE [ 927.287957] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.288083] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.288153] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.288351] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.288442] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.288621] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.288720] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.288782] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.288985] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.289121] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.289270] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.289434] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.289593] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.289653] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.289731] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.289816] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b7494c30-5ed8-4a79-be3b-149fbc4a6497 is going to be updated. [ 927.314431] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.314431] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.314431] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.314431] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.314591] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.314621] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b7494c30-5ed8-4a79-be3b-149fbc4a6497" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.544396] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.544567] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.544629] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.544850] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.545021] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.545140] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0881101-1be1-4dbf-ac18-2d54a689202c is going to be updated. [ 927.588058] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 927.588313] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 927.588455] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 927.588775] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 927.588995] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 927.599864] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0881101-1be1-4dbf-ac18-2d54a689202c in Status: IN_PROGRESS for 2s [ 927.792544] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('9acaf46f-6800-4e8d-bec0-432525de6a87',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 928.295457] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.295628] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.295715] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.295950] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.296055] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.296160] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9acaf46f-6800-4e8d-bec0-432525de6a87 is going to be created. [ 928.323048] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 928.323397] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 928.323397] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 928.323503] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 928.323675] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 928.333108] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9acaf46f-6800-4e8d-bec0-432525de6a87 in Status: UNINITIALIZED for 2s [ 929.610572] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0881101-1be1-4dbf-ac18-2d54a689202c in Status: SUCCESS [ 929.610873] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.610873] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.611161] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.611409] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.611534] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.611602] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.611766] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.611849] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.611936] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.612052] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 929.946736] env[67094]: INFO networking_nsxv3.common.synchronization [req-3ffd38af-90b4-45fb-ba31-8509aec329b3 req-450b788c-d0af-4f60-b2e2-f61b4785c933 tempest-ServersAdminTestJSON-236082081 tempest-ServersAdminTestJSON-236082081-project-member] Enqueued Resource ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f with Priority: HIGHEST for action security_group_members [ 929.947463] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f with Priority: HIGHEST for action security_group_members [ 929.947844] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f2ac94a-4beb-4e79-8490-47989224cf9f taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.947998] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.948086] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.948361] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.948586] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 929.948707] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 929.948770] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 929.949113] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 929.949428] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 929.949655] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f2ac94a-4beb-4e79-8490-47989224cf9f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.114340] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0881101-1be1-4dbf-ac18-2d54a689202c taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.114590] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.114676] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.114918] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.115113] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.115249] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.115289] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.115418] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.115507] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.115598] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.115804] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0881101-1be1-4dbf-ac18-2d54a689202c taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.116013] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.116082] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.116230] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.116378] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.116752] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.116752] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.116752] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.116752] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.116888] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.116888] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.345775] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9acaf46f-6800-4e8d-bec0-432525de6a87 in Status: SUCCESS [ 930.346015] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9acaf46f-6800-4e8d-bec0-432525de6a87" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.346202] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9acaf46f-6800-4e8d-bec0-432525de6a87" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.346424] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9acaf46f-6800-4e8d-bec0-432525de6a87" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.346626] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.346745] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.346812] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.347095] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.347201] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.347288] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9acaf46f-6800-4e8d-bec0-432525de6a87" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.347395] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('9acaf46f-6800-4e8d-bec0-432525de6a87',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.452028] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0f2ac94a-4beb-4e79-8490-47989224cf9f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.619251] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c0881101-1be1-4dbf-ac18-2d54a689202c: rpc.has_security_group_logging(os_id): False [ 930.646134] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.646134] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.647559] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.647559] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.681391] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.681391] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.681391] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.681391] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.681391] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.681391] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.681391] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.681391] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.681391] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.681391] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.681391] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.681391] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.681391] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.681391] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.682050] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.682050] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.682050] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0881101-1be1-4dbf-ac18-2d54a689202c is going to be updated. [ 930.746222] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.746222] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.746222] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.746501] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.746709] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.773923] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0881101-1be1-4dbf-ac18-2d54a689202c in Status: IN_PROGRESS for 2s [ 930.851922] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-9acaf46f-6800-4e8d-bec0-432525de6a87 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.852162] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9acaf46f-6800-4e8d-bec0-432525de6a87" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.852238] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9acaf46f-6800-4e8d-bec0-432525de6a87" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.852482] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9acaf46f-6800-4e8d-bec0-432525de6a87" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.852691] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.852810] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.852861] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.853160] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.853239] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.853332] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9acaf46f-6800-4e8d-bec0-432525de6a87" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.853499] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-9acaf46f-6800-4e8d-bec0-432525de6a87 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.853590] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9acaf46f-6800-4e8d-bec0-432525de6a87" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.853649] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9acaf46f-6800-4e8d-bec0-432525de6a87" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.853793] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9acaf46f-6800-4e8d-bec0-432525de6a87" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.853946] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 930.854042] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 930.854100] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 930.854247] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 930.854320] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.854401] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9acaf46f-6800-4e8d-bec0-432525de6a87" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 930.854500] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('9acaf46f-6800-4e8d-bec0-432525de6a87',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 930.954706] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0f2ac94a-4beb-4e79-8490-47989224cf9f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 931.357072] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 9acaf46f-6800-4e8d-bec0-432525de6a87: rpc.has_security_group_logging(os_id): False [ 931.377924] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.378081] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.378147] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.378374] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.378482] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.378730] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.378842] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.378925] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.379125] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.379207] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.379392] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.379491] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.379548] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.379691] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.379766] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.379941] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.380044] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.380100] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.380239] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.380307] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.380393] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9acaf46f-6800-4e8d-bec0-432525de6a87 is going to be created. [ 931.446091] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.446323] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.446323] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.446541] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.446701] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.457803] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.457979] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.458114] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.458402] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.458519] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.458644] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f is going to be updated. [ 931.460913] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9acaf46f-6800-4e8d-bec0-432525de6a87 in Status: IN_PROGRESS for 2s [ 931.498700] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 931.498895] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 931.499027] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 931.499324] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 931.499507] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 931.510070] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f in Status: IN_PROGRESS for 2s [ 932.812662] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0881101-1be1-4dbf-ac18-2d54a689202c in Status: SUCCESS [ 932.813112] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.474662] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 9acaf46f-6800-4e8d-bec0-432525de6a87 in Status: SUCCESS [ 933.474870] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9acaf46f-6800-4e8d-bec0-432525de6a87" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 933.521347] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f in Status: SUCCESS [ 933.521608] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.361077] env[67094]: INFO networking_nsxv3.common.synchronization [req-cf9445b1-2a33-4e35-a45f-490a3e304fe9 req-b9733720-64f4-4aff-a848-27796c651c94 tempest-SecurityGroupsTestJSON-1233321301 tempest-SecurityGroupsTestJSON-1233321301-project-member] Enqueued Resource ID: f7861002-4b91-437c-8519-9140d1a3bd82 with Priority: HIGHEST for action security_group_members [ 934.361379] env[67094]: INFO networking_nsxv3.common.synchronization [req-cf9445b1-2a33-4e35-a45f-490a3e304fe9 req-b9733720-64f4-4aff-a848-27796c651c94 tempest-SecurityGroupsTestJSON-1233321301 tempest-SecurityGroupsTestJSON-1233321301-project-member] Enqueued Resource ID: 763488f4-7445-4094-9732-5af84c8ba064 with Priority: HIGHEST for action security_group_members [ 934.362231] env[67094]: INFO networking_nsxv3.common.synchronization [req-cf9445b1-2a33-4e35-a45f-490a3e304fe9 req-b9733720-64f4-4aff-a848-27796c651c94 tempest-SecurityGroupsTestJSON-1233321301 tempest-SecurityGroupsTestJSON-1233321301-project-member] Enqueued Resource ID: ae59884c-acbd-4c88-8cdb-fd8d14c95621 with Priority: HIGHEST for action security_group_members [ 934.362231] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7861002-4b91-437c-8519-9140d1a3bd82 with Priority: HIGHEST for action security_group_members [ 934.362898] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 763488f4-7445-4094-9732-5af84c8ba064 with Priority: HIGHEST for action security_group_members [ 934.363071] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae59884c-acbd-4c88-8cdb-fd8d14c95621 with Priority: HIGHEST for action security_group_members [ 934.363392] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-f7861002-4b91-437c-8519-9140d1a3bd82 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.363547] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.363594] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.363789] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.363951] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.364059] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.364118] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.365042] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.365154] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.365259] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('f7861002-4b91-437c-8519-9140d1a3bd82',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.366255] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-763488f4-7445-4094-9732-5af84c8ba064 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.366427] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-763488f4-7445-4094-9732-5af84c8ba064" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.366506] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-763488f4-7445-4094-9732-5af84c8ba064" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.367018] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-763488f4-7445-4094-9732-5af84c8ba064" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.367018] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.367018] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.367018] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.367179] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.367222] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.367316] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('763488f4-7445-4094-9732-5af84c8ba064',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.368225] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-ae59884c-acbd-4c88-8cdb-fd8d14c95621 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.368328] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-ae59884c-acbd-4c88-8cdb-fd8d14c95621" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.368392] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-ae59884c-acbd-4c88-8cdb-fd8d14c95621" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.368537] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-ae59884c-acbd-4c88-8cdb-fd8d14c95621" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.370252] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.370252] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.370252] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.370252] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.370252] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.370252] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('ae59884c-acbd-4c88-8cdb-fd8d14c95621',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 934.872036] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.872203] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.872321] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.872601] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.872760] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.873122] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.873235] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.873307] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.873480] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.873548] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.873637] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7861002-4b91-437c-8519-9140d1a3bd82 is going to be updated. [ 934.874800] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.874928] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.874998] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.875162] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.876220] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.876313] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.894407] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.894700] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.894827] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.894895] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.895094] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.895170] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.895262] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 763488f4-7445-4094-9732-5af84c8ba064 is going to be updated. [ 934.896199] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.896366] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.925756] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.925981] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.926148] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.926417] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.926595] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.928692] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.928924] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.929081] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.929133] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.929387] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.929521] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.929623] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae59884c-acbd-4c88-8cdb-fd8d14c95621 is going to be updated. [ 934.946297] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7861002-4b91-437c-8519-9140d1a3bd82 in Status: IN_PROGRESS for 2s [ 934.949847] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.950095] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.950095] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.950470] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.950618] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.960699] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 763488f4-7445-4094-9732-5af84c8ba064 in Status: IN_PROGRESS for 2s [ 934.973730] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 934.973971] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 934.974127] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 934.974498] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 934.974730] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 934.984790] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae59884c-acbd-4c88-8cdb-fd8d14c95621 in Status: IN_PROGRESS for 2s [ 935.494285] env[67094]: INFO networking_nsxv3.common.synchronization [req-a93c4bd3-dbcf-4d52-9c39-1965271ce068 req-afad9b75-89d0-4be7-a448-c7b015d299e1 tempest-ServersTestJSON-1070791530 tempest-ServersTestJSON-1070791530-project-member] Enqueued Resource ID: c0881101-1be1-4dbf-ac18-2d54a689202c with Priority: HIGHEST for action security_group_members [ 935.495281] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0881101-1be1-4dbf-ac18-2d54a689202c with Priority: HIGHEST for action security_group_members [ 935.495281] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0881101-1be1-4dbf-ac18-2d54a689202c taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.495281] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.495281] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.495491] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.495491] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 935.495562] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 935.495781] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 935.495781] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 935.495872] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 935.495907] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 935.997842] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.501623] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 936.958106] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: f7861002-4b91-437c-8519-9140d1a3bd82 in Status: SUCCESS [ 936.958106] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: f7861002-4b91-437c-8519-9140d1a3bd82 deletion is rescheduled due to dependency. [ 936.958106] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.970158] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 763488f4-7445-4094-9732-5af84c8ba064 in Status: SUCCESS [ 936.970158] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 763488f4-7445-4094-9732-5af84c8ba064 deletion is rescheduled due to dependency. [ 936.970158] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-763488f4-7445-4094-9732-5af84c8ba064" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 936.994312] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: ae59884c-acbd-4c88-8cdb-fd8d14c95621 in Status: SUCCESS [ 936.994312] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: ae59884c-acbd-4c88-8cdb-fd8d14c95621 deletion is rescheduled due to dependency. [ 936.994438] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-ae59884c-acbd-4c88-8cdb-fd8d14c95621" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.007432] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.007582] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.007651] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.007860] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.007943] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.008055] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0881101-1be1-4dbf-ac18-2d54a689202c is going to be updated. [ 937.010040] env[67094]: INFO networking_nsxv3.common.synchronization [req-07ef1070-63ef-42fd-b056-e1ea5204a4b6 req-cba828fa-1a7e-41f4-a51c-e2e49e379df6 tempest-ServerRescueNegativeTestJSON-389115858 tempest-ServerRescueNegativeTestJSON-389115858-project-member] Enqueued Resource ID: b61bfa2d-4c26-4a49-a153-4a8fb6153ccd with Priority: HIGHEST for action security_group_members [ 937.010616] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b61bfa2d-4c26-4a49-a153-4a8fb6153ccd with Priority: HIGHEST for action security_group_members [ 937.011363] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-b61bfa2d-4c26-4a49-a153-4a8fb6153ccd taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.011480] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b61bfa2d-4c26-4a49-a153-4a8fb6153ccd" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.011564] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b61bfa2d-4c26-4a49-a153-4a8fb6153ccd" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.011946] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b61bfa2d-4c26-4a49-a153-4a8fb6153ccd" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.012115] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.012249] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.012291] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.012427] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.012496] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.012578] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b61bfa2d-4c26-4a49-a153-4a8fb6153ccd',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.039448] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.039618] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.039678] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.039863] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.040070] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.050581] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0881101-1be1-4dbf-ac18-2d54a689202c in Status: IN_PROGRESS for 2s [ 937.358941] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock network-861 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.359245] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "network-861" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.359394] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "network-861" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.359701] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "network-861" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.360038] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.360522] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.360522] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.360686] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.360835] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.361077] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 937.361251] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 937.361437] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 937.361628] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 937.361814] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 937.362011] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 937.362205] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 937.383073] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 937.383264] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 937.383403] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 937.383580] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "network-861" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.383899] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock port-97ac0598-bac3-494e-b697-1db95030b607 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.384502] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "port-97ac0598-bac3-494e-b697-1db95030b607" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.384502] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "port-97ac0598-bac3-494e-b697-1db95030b607" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.384660] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "port-97ac0598-bac3-494e-b697-1db95030b607" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.384660] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97ac0598-bac3-494e-b697-1db95030b607',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 937.515849] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.516350] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.516350] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.516350] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.516530] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.516623] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.516735] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.516944] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.517071] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.517199] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.517295] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b61bfa2d-4c26-4a49-a153-4a8fb6153ccd already deleted. [ 937.517393] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b61bfa2d-4c26-4a49-a153-4a8fb6153ccd" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.886838] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.887255] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.887419] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.887706] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.888295] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.888295] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Segment Port 97ac0598-bac3-494e-b697-1db95030b607 not found, creating... [ 937.888435] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.888592] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.888697] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.888933] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.889294] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.889801] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.890089] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.890688] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.890688] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.890688] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.890867] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Resource: SegmentPort with ID: 97ac0598-bac3-494e-b697-1db95030b607 is going to be created. [ 937.913963] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 937.914298] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 937.914371] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 937.914639] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 937.914976] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 937.915146] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "port-97ac0598-bac3-494e-b697-1db95030b607" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.641293] env[67094]: INFO networking_nsxv3.common.synchronization [req-07ef1070-63ef-42fd-b056-e1ea5204a4b6 req-eb7c6ff7-21b1-434d-a485-88361377c839 service nova] Enqueued Resource ID: b61bfa2d-4c26-4a49-a153-4a8fb6153ccd with Priority: HIGHEST for action security_group_rules [ 938.641293] env[67094]: INFO networking_nsxv3.common.synchronization [req-07ef1070-63ef-42fd-b056-e1ea5204a4b6 req-eb7c6ff7-21b1-434d-a485-88361377c839 service nova] Enqueued Resource ID: b61bfa2d-4c26-4a49-a153-4a8fb6153ccd with Priority: HIGHEST for action security_group_members [ 938.641293] env[67094]: INFO networking_nsxv3.common.synchronization [req-07ef1070-63ef-42fd-b056-e1ea5204a4b6 req-eb7c6ff7-21b1-434d-a485-88361377c839 service nova] Enqueued Resource ID: 97ac0598-bac3-494e-b697-1db95030b607 with Priority: HIGHEST for action port [ 938.641293] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b61bfa2d-4c26-4a49-a153-4a8fb6153ccd with Priority: HIGHEST for action security_group_rules [ 938.641293] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b61bfa2d-4c26-4a49-a153-4a8fb6153ccd with Priority: HIGHEST for action security_group_members [ 938.641293] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 97ac0598-bac3-494e-b697-1db95030b607 with Priority: HIGHEST for action port [ 938.641293] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b61bfa2d-4c26-4a49-a153-4a8fb6153ccd taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.641293] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b61bfa2d-4c26-4a49-a153-4a8fb6153ccd" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.641293] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b61bfa2d-4c26-4a49-a153-4a8fb6153ccd" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.641293] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b61bfa2d-4c26-4a49-a153-4a8fb6153ccd" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.641783] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b61bfa2d-4c26-4a49-a153-4a8fb6153ccd',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.642643] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-b61bfa2d-4c26-4a49-a153-4a8fb6153ccd taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.642803] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b61bfa2d-4c26-4a49-a153-4a8fb6153ccd" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.642927] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b61bfa2d-4c26-4a49-a153-4a8fb6153ccd" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.643125] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b61bfa2d-4c26-4a49-a153-4a8fb6153ccd" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.643299] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.643441] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.643519] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.643709] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.643825] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 938.643945] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b61bfa2d-4c26-4a49-a153-4a8fb6153ccd',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 938.646308] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-97ac0598-bac3-494e-b697-1db95030b607 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 938.646426] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-97ac0598-bac3-494e-b697-1db95030b607" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 938.646497] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-97ac0598-bac3-494e-b697-1db95030b607" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 938.646678] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-97ac0598-bac3-494e-b697-1db95030b607" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 938.646756] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('97ac0598-bac3-494e-b697-1db95030b607',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.061820] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0881101-1be1-4dbf-ac18-2d54a689202c in Status: SUCCESS [ 939.061820] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.150893] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b61bfa2d-4c26-4a49-a153-4a8fb6153ccd',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 939.152048] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-b61bfa2d-4c26-4a49-a153-4a8fb6153ccd taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.152194] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b61bfa2d-4c26-4a49-a153-4a8fb6153ccd" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.152278] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 97ac0598-bac3-494e-b697-1db95030b607 with status ACTIVE [ 939.152440] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.152589] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.152655] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.152805] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.152891] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.153075] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.153170] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.153227] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.153433] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.153545] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.153709] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.153802] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.153861] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.154013] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.154088] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.154172] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 97ac0598-bac3-494e-b697-1db95030b607 is going to be updated. [ 939.186176] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 939.186369] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 939.186445] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 939.186667] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 939.186814] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.187418] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-97ac0598-bac3-494e-b697-1db95030b607" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 939.657164] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b61bfa2d-4c26-4a49-a153-4a8fb6153ccd',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 940.159535] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.159726] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.159812] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.160062] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.160156] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.160289] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b61bfa2d-4c26-4a49-a153-4a8fb6153ccd is going to be created. [ 940.188090] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 940.188330] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 940.188330] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 940.188765] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 940.188765] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 940.198225] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b61bfa2d-4c26-4a49-a153-4a8fb6153ccd in Status: UNINITIALIZED for 2s [ 941.820788] env[67094]: INFO networking_nsxv3.common.synchronization [req-57e792cc-94bf-4a9f-9b80-f3fa9579f595 req-4226703a-3f4c-4179-aa74-30b98282e834 tempest-ImagesTestJSON-2097058733 tempest-ImagesTestJSON-2097058733-project-member] Enqueued Resource ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa with Priority: HIGHEST for action security_group_members [ 941.821461] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa with Priority: HIGHEST for action security_group_members [ 941.821792] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-84918628-8f8e-4d25-9c0f-17cccb58ebfa taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.821914] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.821980] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.822350] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.822823] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 941.822953] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 941.823033] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 941.823216] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 941.823295] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 941.823375] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('84918628-8f8e-4d25-9c0f-17cccb58ebfa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.074297] env[67094]: INFO networking_nsxv3.common.synchronization [req-74fe155c-cccd-4beb-910e-ef9b5f76561b req-c684674e-1efe-4b08-8358-02798a53885b tempest-AttachInterfacesV270Test-93374714 tempest-AttachInterfacesV270Test-93374714-project-member] Enqueued Resource ID: 9acaf46f-6800-4e8d-bec0-432525de6a87 with Priority: HIGHEST for action security_group_members [ 942.074825] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9acaf46f-6800-4e8d-bec0-432525de6a87 with Priority: HIGHEST for action security_group_members [ 942.076193] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-9acaf46f-6800-4e8d-bec0-432525de6a87 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.076377] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-9acaf46f-6800-4e8d-bec0-432525de6a87" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.077801] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-9acaf46f-6800-4e8d-bec0-432525de6a87" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.078062] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-9acaf46f-6800-4e8d-bec0-432525de6a87" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.078235] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.078337] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.078400] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.078556] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.078641] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.078734] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('9acaf46f-6800-4e8d-bec0-432525de6a87',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.195772] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock network-842 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.195978] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "network-842" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.196113] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "network-842" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.196375] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "network-842" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.196627] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.197020] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.197196] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.197482] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.197786] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.198723] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 942.198723] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 942.198723] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 942.198723] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 942.198723] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 942.198723] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 942.198723] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 942.209227] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b61bfa2d-4c26-4a49-a153-4a8fb6153ccd in Status: UNINITIALIZED for 4s [ 942.221765] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 942.222256] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 942.222463] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 942.223032] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "network-842" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.223114] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock port-e253bc8b-1812-43af-92db-7990d00be278 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.223304] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "port-e253bc8b-1812-43af-92db-7990d00be278" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.223416] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "port-e253bc8b-1812-43af-92db-7990d00be278" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.223729] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "port-e253bc8b-1812-43af-92db-7990d00be278" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.223879] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e253bc8b-1812-43af-92db-7990d00be278',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 942.325483] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.325658] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.325728] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.325987] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.326047] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.327034] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.327034] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.327034] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.327034] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.327034] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.327034] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa is going to be updated. [ 942.357866] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.357866] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.358221] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.358221] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.358358] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.370224] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa in Status: IN_PROGRESS for 2s [ 942.582254] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.582254] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.582254] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.582454] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.582454] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.582574] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.582674] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.582737] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.582889] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.582964] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.583070] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9acaf46f-6800-4e8d-bec0-432525de6a87 is going to be updated. [ 942.615969] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.616162] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.616206] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.616417] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.616557] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.628157] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9acaf46f-6800-4e8d-bec0-432525de6a87 in Status: IN_PROGRESS for 2s [ 942.726597] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.726928] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.727104] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.727389] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.727543] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.727696] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Segment Port e253bc8b-1812-43af-92db-7990d00be278 not found, creating... [ 942.727967] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.728193] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.728319] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.728539] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.728679] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.728991] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.729205] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.729326] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.729533] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.729666] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.729801] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Resource: SegmentPort with ID: e253bc8b-1812-43af-92db-7990d00be278 is going to be created. [ 942.758069] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 942.758069] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 942.758069] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 942.758367] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 942.758367] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 942.758567] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "port-e253bc8b-1812-43af-92db-7990d00be278" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 943.504323] env[67094]: INFO networking_nsxv3.common.synchronization [req-57e792cc-94bf-4a9f-9b80-f3fa9579f595 req-3722a7c2-1243-40eb-93d8-71e6d5797a3f service nova] Enqueued Resource ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa with Priority: HIGHEST for action security_group_rules [ 943.504586] env[67094]: INFO networking_nsxv3.common.synchronization [req-57e792cc-94bf-4a9f-9b80-f3fa9579f595 req-3722a7c2-1243-40eb-93d8-71e6d5797a3f service nova] Enqueued Resource ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa with Priority: HIGHEST for action security_group_members [ 943.504802] env[67094]: INFO networking_nsxv3.common.synchronization [req-57e792cc-94bf-4a9f-9b80-f3fa9579f595 req-3722a7c2-1243-40eb-93d8-71e6d5797a3f service nova] Enqueued Resource ID: e253bc8b-1812-43af-92db-7990d00be278 with Priority: HIGHEST for action port [ 943.507101] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa with Priority: HIGHEST for action security_group_rules [ 943.507101] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa with Priority: HIGHEST for action security_group_members [ 943.507257] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e253bc8b-1812-43af-92db-7990d00be278 with Priority: HIGHEST for action port [ 943.507560] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-84918628-8f8e-4d25-9c0f-17cccb58ebfa taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.507750] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.507831] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.508050] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.508142] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('84918628-8f8e-4d25-9c0f-17cccb58ebfa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 943.509115] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-84918628-8f8e-4d25-9c0f-17cccb58ebfa taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.509234] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.509431] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-e253bc8b-1812-43af-92db-7990d00be278 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 943.509532] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e253bc8b-1812-43af-92db-7990d00be278" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 943.509604] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e253bc8b-1812-43af-92db-7990d00be278" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 943.509786] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e253bc8b-1812-43af-92db-7990d00be278" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 943.509865] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e253bc8b-1812-43af-92db-7990d00be278',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.012940] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-84918628-8f8e-4d25-9c0f-17cccb58ebfa taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.013120] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.013294] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e253bc8b-1812-43af-92db-7990d00be278 with status ACTIVE [ 944.013428] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.013533] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.013589] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.013797] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.013877] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.014061] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.014151] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.014211] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.014354] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.014427] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.014607] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.014742] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.014742] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.014874] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.014952] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.015029] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e253bc8b-1812-43af-92db-7990d00be278 is going to be updated. [ 944.037784] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.038920] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.038920] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.038920] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.038920] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.038920] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e253bc8b-1812-43af-92db-7990d00be278" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.221920] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b61bfa2d-4c26-4a49-a153-4a8fb6153ccd in Status: SUCCESS [ 944.222202] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b61bfa2d-4c26-4a49-a153-4a8fb6153ccd" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.222391] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b61bfa2d-4c26-4a49-a153-4a8fb6153ccd" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.222665] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b61bfa2d-4c26-4a49-a153-4a8fb6153ccd" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.222887] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.223024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.223108] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.223370] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.223475] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.223572] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b61bfa2d-4c26-4a49-a153-4a8fb6153ccd" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.223687] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b61bfa2d-4c26-4a49-a153-4a8fb6153ccd',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.382081] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa in Status: SUCCESS [ 944.382081] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa deletion is rescheduled due to dependency. [ 944.382081] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.382081] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.382081] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.382081] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 944.382692] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 944.382692] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 944.382692] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 944.382692] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.382692] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('84918628-8f8e-4d25-9c0f-17cccb58ebfa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.640799] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 9acaf46f-6800-4e8d-bec0-432525de6a87 in Status: SUCCESS [ 944.642415] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 9acaf46f-6800-4e8d-bec0-432525de6a87 deletion is rescheduled due to dependency. [ 944.642415] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-9acaf46f-6800-4e8d-bec0-432525de6a87" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 944.728577] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b61bfa2d-4c26-4a49-a153-4a8fb6153ccd',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 944.885046] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('84918628-8f8e-4d25-9c0f-17cccb58ebfa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.231092] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b61bfa2d-4c26-4a49-a153-4a8fb6153ccd: rpc.has_security_group_logging(os_id): False [ 945.259251] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.259754] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.259868] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.260113] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.260285] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.260560] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.260678] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.260733] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.260889] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.260956] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.261049] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b61bfa2d-4c26-4a49-a153-4a8fb6153ccd is going to be created. [ 945.334161] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.334161] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.334161] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.334161] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.334161] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.344963] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b61bfa2d-4c26-4a49-a153-4a8fb6153ccd in Status: IN_PROGRESS for 2s [ 945.388900] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('84918628-8f8e-4d25-9c0f-17cccb58ebfa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 945.891324] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.891744] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.891744] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.891825] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.891917] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.893229] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa is going to be updated. [ 945.924356] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 945.924528] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 945.924587] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 945.924799] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 945.924945] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 945.933915] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa in Status: IN_PROGRESS for 2s [ 947.361701] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b61bfa2d-4c26-4a49-a153-4a8fb6153ccd in Status: SUCCESS [ 947.361701] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b61bfa2d-4c26-4a49-a153-4a8fb6153ccd" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.946392] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa in Status: SUCCESS [ 947.946622] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.946817] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.947156] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.947434] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 947.947571] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 947.947640] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 947.947875] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 947.947999] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.948114] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 947.948226] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('84918628-8f8e-4d25-9c0f-17cccb58ebfa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.450600] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-84918628-8f8e-4d25-9c0f-17cccb58ebfa taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.450885] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.450885] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.450993] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.451161] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.451273] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.451316] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.452046] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.452046] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.452046] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.452046] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-84918628-8f8e-4d25-9c0f-17cccb58ebfa taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.452046] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.452046] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.452298] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.452298] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.452363] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.452424] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.452672] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.452799] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.452891] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.452987] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('84918628-8f8e-4d25-9c0f-17cccb58ebfa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.507775] env[67094]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 948.507942] env[67094]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 948.551201] env[67094]: INFO networking_nsxv3.common.synchronization [req-cd1e7a01-63c3-4fc5-b087-7c887d7b40b7 req-bba91c4a-3b1e-4410-8f28-a782f317d895 tempest-ServerActionsTestOtherA-276518123 tempest-ServerActionsTestOtherA-276518123-project-member] Enqueued Resource ID: 6745d4e2-6069-4132-80d9-76cf2245b017 with Priority: HIGHEST for action security_group_members [ 948.551796] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6745d4e2-6069-4132-80d9-76cf2245b017 with Priority: HIGHEST for action security_group_members [ 948.552148] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-6745d4e2-6069-4132-80d9-76cf2245b017 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.552273] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6745d4e2-6069-4132-80d9-76cf2245b017" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.552340] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6745d4e2-6069-4132-80d9-76cf2245b017" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.552635] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6745d4e2-6069-4132-80d9-76cf2245b017" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.552796] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.552901] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.552959] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.553153] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.553232] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.553361] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6745d4e2-6069-4132-80d9-76cf2245b017',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.949527] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock network-997 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.949740] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "network-997" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.949870] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "network-997" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.950502] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "network-997" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.950502] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.950673] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.950712] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.950943] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.951106] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.951499] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 948.951499] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 948.951617] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 948.951706] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 948.951741] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 948.951835] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 948.951978] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 948.954975] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 84918628-8f8e-4d25-9c0f-17cccb58ebfa: rpc.has_security_group_logging(os_id): False [ 948.974789] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 948.975017] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 948.975173] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 948.975353] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "network-997" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.975658] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock port-249b8390-b428-4d89-b9be-3ebf2eeca956 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.975850] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "port-249b8390-b428-4d89-b9be-3ebf2eeca956" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.976068] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "port-249b8390-b428-4d89-b9be-3ebf2eeca956" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.976833] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "port-249b8390-b428-4d89-b9be-3ebf2eeca956" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.976833] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('249b8390-b428-4d89-b9be-3ebf2eeca956',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 948.979300] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.981783] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.981783] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.981783] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.981783] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.981783] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.981783] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.981783] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.981783] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.981783] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.981783] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.981783] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.981783] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.981783] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.981783] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.982614] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 948.982614] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 948.982614] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 948.982614] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 948.982614] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 948.982614] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa is going to be updated. [ 949.056755] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.056893] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.056947] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.057218] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.057317] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.057483] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.057576] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.057628] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.057772] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.057844] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.057925] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6745d4e2-6069-4132-80d9-76cf2245b017 already deleted. [ 949.058040] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6745d4e2-6069-4132-80d9-76cf2245b017" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.059867] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.060175] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.060247] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.060444] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.060658] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.076087] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa in Status: IN_PROGRESS for 2s [ 949.483816] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.484170] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.484212] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.484494] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.484652] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.484798] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Segment Port 249b8390-b428-4d89-b9be-3ebf2eeca956 not found, creating... [ 949.485079] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.485243] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.485361] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.485583] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.485720] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.486017] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.486194] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.486329] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.486537] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.486675] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.486805] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Resource: SegmentPort with ID: 249b8390-b428-4d89-b9be-3ebf2eeca956 is going to be created. [ 949.511749] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 949.511749] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 949.511749] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 949.511749] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 949.511749] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 949.512165] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "port-249b8390-b428-4d89-b9be-3ebf2eeca956" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.244385] env[67094]: INFO networking_nsxv3.common.synchronization [req-cd1e7a01-63c3-4fc5-b087-7c887d7b40b7 req-61abdced-4a42-4d39-ad8f-97b856d599ca service nova] Enqueued Resource ID: 6745d4e2-6069-4132-80d9-76cf2245b017 with Priority: HIGHEST for action security_group_rules [ 950.244385] env[67094]: INFO networking_nsxv3.common.synchronization [req-cd1e7a01-63c3-4fc5-b087-7c887d7b40b7 req-61abdced-4a42-4d39-ad8f-97b856d599ca service nova] Enqueued Resource ID: 6745d4e2-6069-4132-80d9-76cf2245b017 with Priority: HIGHEST for action security_group_members [ 950.244385] env[67094]: INFO networking_nsxv3.common.synchronization [req-cd1e7a01-63c3-4fc5-b087-7c887d7b40b7 req-61abdced-4a42-4d39-ad8f-97b856d599ca service nova] Enqueued Resource ID: 249b8390-b428-4d89-b9be-3ebf2eeca956 with Priority: HIGHEST for action port [ 950.244385] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6745d4e2-6069-4132-80d9-76cf2245b017 with Priority: HIGHEST for action security_group_rules [ 950.244833] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6745d4e2-6069-4132-80d9-76cf2245b017 with Priority: HIGHEST for action security_group_members [ 950.245231] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 249b8390-b428-4d89-b9be-3ebf2eeca956 with Priority: HIGHEST for action port [ 950.245748] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6745d4e2-6069-4132-80d9-76cf2245b017 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.246132] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6745d4e2-6069-4132-80d9-76cf2245b017" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.246357] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6745d4e2-6069-4132-80d9-76cf2245b017" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.246721] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6745d4e2-6069-4132-80d9-76cf2245b017" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.247355] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6745d4e2-6069-4132-80d9-76cf2245b017',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.257249] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-6745d4e2-6069-4132-80d9-76cf2245b017 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.257249] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6745d4e2-6069-4132-80d9-76cf2245b017" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.257249] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6745d4e2-6069-4132-80d9-76cf2245b017" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.257249] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6745d4e2-6069-4132-80d9-76cf2245b017" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.257249] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.257249] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.257249] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.257249] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.257249] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.257249] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6745d4e2-6069-4132-80d9-76cf2245b017',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.257249] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-249b8390-b428-4d89-b9be-3ebf2eeca956 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.257249] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-249b8390-b428-4d89-b9be-3ebf2eeca956" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.257249] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-249b8390-b428-4d89-b9be-3ebf2eeca956" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.257249] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-249b8390-b428-4d89-b9be-3ebf2eeca956" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.258086] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('249b8390-b428-4d89-b9be-3ebf2eeca956',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.757022] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-6745d4e2-6069-4132-80d9-76cf2245b017 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.757022] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6745d4e2-6069-4132-80d9-76cf2245b017" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.760475] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6745d4e2-6069-4132-80d9-76cf2245b017',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 950.762838] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 249b8390-b428-4d89-b9be-3ebf2eeca956 with status ACTIVE [ 950.762838] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.762838] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.762838] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.762838] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.763431] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.763431] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.763431] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.763431] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.763431] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.763928] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.763928] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.763928] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.763928] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.763928] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.764094] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.764094] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 249b8390-b428-4d89-b9be-3ebf2eeca956 is going to be updated. [ 950.788873] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 950.789032] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 950.789166] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 950.789383] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 950.789766] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 950.789766] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-249b8390-b428-4d89-b9be-3ebf2eeca956" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.092556] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa in Status: SUCCESS [ 951.092802] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.158672] env[67094]: INFO networking_nsxv3.common.synchronization [req-718210b7-17fc-4813-a42a-1fd9ac328452 req-d0323ff3-dcd5-4da2-9a9b-a519f124014b tempest-AttachVolumeTestJSON-829034394 tempest-AttachVolumeTestJSON-829034394-project-member] Enqueued Resource ID: 529c6563-9354-49e2-8282-acd28e0b0ef7 with Priority: HIGHEST for action security_group_members [ 951.159331] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 529c6563-9354-49e2-8282-acd28e0b0ef7 with Priority: HIGHEST for action security_group_members [ 951.159674] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-529c6563-9354-49e2-8282-acd28e0b0ef7 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.159799] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-529c6563-9354-49e2-8282-acd28e0b0ef7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.159864] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-529c6563-9354-49e2-8282-acd28e0b0ef7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.160266] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-529c6563-9354-49e2-8282-acd28e0b0ef7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.160446] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.160551] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.160640] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.160868] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.160994] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.161113] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('529c6563-9354-49e2-8282-acd28e0b0ef7',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.263599] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6745d4e2-6069-4132-80d9-76cf2245b017',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.501023] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock network-166 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.501234] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "network-166" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.501359] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "network-166" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.501671] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "network-166" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.501937] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.504091] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.504244] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.504496] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.504648] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.504861] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 951.504976] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 951.505113] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 951.505199] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 951.505312] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 951.505414] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 951.505542] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 951.526861] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 951.526861] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 951.526861] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 951.526861] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "network-166" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.526861] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock port-1af72a66-c84d-4426-b802-e3e8457bb6f4 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.526861] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "port-1af72a66-c84d-4426-b802-e3e8457bb6f4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.526861] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "port-1af72a66-c84d-4426-b802-e3e8457bb6f4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.526861] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "port-1af72a66-c84d-4426-b802-e3e8457bb6f4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.526861] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1af72a66-c84d-4426-b802-e3e8457bb6f4',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 951.663565] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.663781] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.663901] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.664352] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.664561] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.664811] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.664941] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.665059] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.665238] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.665334] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.665434] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 529c6563-9354-49e2-8282-acd28e0b0ef7 already deleted. [ 951.665593] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-529c6563-9354-49e2-8282-acd28e0b0ef7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.765560] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.766535] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.766535] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.766535] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.766535] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.766535] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6745d4e2-6069-4132-80d9-76cf2245b017 is going to be created. [ 951.791839] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 951.791998] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 951.794096] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 951.794096] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 951.794096] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 951.804663] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6745d4e2-6069-4132-80d9-76cf2245b017 in Status: UNINITIALIZED for 2s [ 952.028745] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.029022] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.029189] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.029509] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.029661] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.029814] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Segment Port 1af72a66-c84d-4426-b802-e3e8457bb6f4 not found, creating... [ 952.030092] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.030255] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.030372] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.030593] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.030791] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.031108] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.031267] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.031382] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.031604] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.031721] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.031851] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Resource: SegmentPort with ID: 1af72a66-c84d-4426-b802-e3e8457bb6f4 is going to be created. [ 952.053723] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.053951] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.054099] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.054393] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.054632] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.054850] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "port-1af72a66-c84d-4426-b802-e3e8457bb6f4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.794632] env[67094]: INFO networking_nsxv3.common.synchronization [req-4b85029e-26e7-4bdb-84ef-028c34a49c21 req-90d4a84b-b948-4468-9fdb-ea154a40be1d tempest-ServersWithSpecificFlavorTestJSON-602104183 tempest-ServersWithSpecificFlavorTestJSON-602104183-project-member] Enqueued Resource ID: 60943622-73b5-4dda-ad21-63bf08db617e with Priority: HIGHEST for action security_group_members [ 952.795565] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 60943622-73b5-4dda-ad21-63bf08db617e with Priority: HIGHEST for action security_group_members [ 952.795856] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-60943622-73b5-4dda-ad21-63bf08db617e taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.795996] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-60943622-73b5-4dda-ad21-63bf08db617e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.796053] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-60943622-73b5-4dda-ad21-63bf08db617e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.796247] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-60943622-73b5-4dda-ad21-63bf08db617e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.796396] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.796495] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.796556] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.796713] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.796799] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.796904] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('60943622-73b5-4dda-ad21-63bf08db617e',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.815774] env[67094]: INFO networking_nsxv3.common.synchronization [req-718210b7-17fc-4813-a42a-1fd9ac328452 req-01d20234-7491-4d7b-a70d-9be33301168d service nova] Enqueued Resource ID: 529c6563-9354-49e2-8282-acd28e0b0ef7 with Priority: HIGHEST for action security_group_rules [ 952.815952] env[67094]: INFO networking_nsxv3.common.synchronization [req-718210b7-17fc-4813-a42a-1fd9ac328452 req-01d20234-7491-4d7b-a70d-9be33301168d service nova] Enqueued Resource ID: 529c6563-9354-49e2-8282-acd28e0b0ef7 with Priority: HIGHEST for action security_group_members [ 952.816108] env[67094]: INFO networking_nsxv3.common.synchronization [req-718210b7-17fc-4813-a42a-1fd9ac328452 req-01d20234-7491-4d7b-a70d-9be33301168d service nova] Enqueued Resource ID: 1af72a66-c84d-4426-b802-e3e8457bb6f4 with Priority: HIGHEST for action port [ 952.816568] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 529c6563-9354-49e2-8282-acd28e0b0ef7 with Priority: HIGHEST for action security_group_rules [ 952.816702] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 529c6563-9354-49e2-8282-acd28e0b0ef7 with Priority: HIGHEST for action security_group_members [ 952.816799] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1af72a66-c84d-4426-b802-e3e8457bb6f4 with Priority: HIGHEST for action port [ 952.817238] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-529c6563-9354-49e2-8282-acd28e0b0ef7 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.817355] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-529c6563-9354-49e2-8282-acd28e0b0ef7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.817415] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-529c6563-9354-49e2-8282-acd28e0b0ef7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.817621] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-529c6563-9354-49e2-8282-acd28e0b0ef7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.817702] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('529c6563-9354-49e2-8282-acd28e0b0ef7',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.818603] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-529c6563-9354-49e2-8282-acd28e0b0ef7 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.818653] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-529c6563-9354-49e2-8282-acd28e0b0ef7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.819049] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-529c6563-9354-49e2-8282-acd28e0b0ef7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.819256] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-529c6563-9354-49e2-8282-acd28e0b0ef7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.819407] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.819624] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.819702] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.819869] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.819978] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 952.820065] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('529c6563-9354-49e2-8282-acd28e0b0ef7',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 952.821524] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-1af72a66-c84d-4426-b802-e3e8457bb6f4 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 952.821606] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1af72a66-c84d-4426-b802-e3e8457bb6f4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 952.821761] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1af72a66-c84d-4426-b802-e3e8457bb6f4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 952.821938] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1af72a66-c84d-4426-b802-e3e8457bb6f4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 952.822049] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1af72a66-c84d-4426-b802-e3e8457bb6f4',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.298920] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.299125] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.299218] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.299449] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.322195] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.322460] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.322576] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.323432] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.323432] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.323432] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.323432] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60943622-73b5-4dda-ad21-63bf08db617e is going to be updated. [ 953.324331] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('529c6563-9354-49e2-8282-acd28e0b0ef7',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.325365] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-529c6563-9354-49e2-8282-acd28e0b0ef7 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.325498] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-529c6563-9354-49e2-8282-acd28e0b0ef7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.326109] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1af72a66-c84d-4426-b802-e3e8457bb6f4 with status ACTIVE [ 953.326109] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.326109] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.326109] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.326109] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.326321] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.326321] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.326403] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.326434] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.326596] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.326650] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.326817] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.326906] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.326962] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.327133] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.327188] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.327256] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1af72a66-c84d-4426-b802-e3e8457bb6f4 is going to be updated. [ 953.351649] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.351737] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.351952] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.352014] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.352155] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.352316] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1af72a66-c84d-4426-b802-e3e8457bb6f4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.359291] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.359453] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.359573] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.359716] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.359861] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.372052] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60943622-73b5-4dda-ad21-63bf08db617e in Status: IN_PROGRESS for 2s [ 953.718980] env[67094]: INFO networking_nsxv3.common.synchronization [req-f3982418-d24e-433f-9831-55abfd48d552 req-85ac1d3b-3e8b-4065-8a19-e66378653a47 tempest-ServerRescueTestJSON-685643514 tempest-ServerRescueTestJSON-685643514-project-member] Enqueued Resource ID: 3ece2d85-d26d-4c59-ae47-b9a59cc4de8f with Priority: HIGHEST for action security_group_members [ 953.719625] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ece2d85-d26d-4c59-ae47-b9a59cc4de8f with Priority: HIGHEST for action security_group_members [ 953.719949] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ece2d85-d26d-4c59-ae47-b9a59cc4de8f taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.720560] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ece2d85-d26d-4c59-ae47-b9a59cc4de8f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.720646] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ece2d85-d26d-4c59-ae47-b9a59cc4de8f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.720829] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ece2d85-d26d-4c59-ae47-b9a59cc4de8f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.720990] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.721214] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.721284] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.721502] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.722093] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.722200] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ece2d85-d26d-4c59-ae47-b9a59cc4de8f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.814961] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6745d4e2-6069-4132-80d9-76cf2245b017 in Status: SUCCESS [ 953.816548] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6745d4e2-6069-4132-80d9-76cf2245b017" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.816548] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6745d4e2-6069-4132-80d9-76cf2245b017" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.816548] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6745d4e2-6069-4132-80d9-76cf2245b017" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.816548] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 953.816548] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 953.816548] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 953.816903] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 953.816903] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.817079] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6745d4e2-6069-4132-80d9-76cf2245b017" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 953.817254] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6745d4e2-6069-4132-80d9-76cf2245b017',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 953.829578] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('529c6563-9354-49e2-8282-acd28e0b0ef7',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.081749] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock network-631 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.081946] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "network-631" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.082080] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "network-631" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.082348] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "network-631" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.082606] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.082758] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.082870] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.083089] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.083230] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.083430] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 954.083539] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 954.083672] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 954.083745] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 954.083851] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 954.083953] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 954.084092] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 954.103348] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 954.103518] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 954.103651] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 954.103817] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "network-631" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.104173] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock port-236d7d76-f182-43f3-99aa-d9833c772100 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.104302] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "port-236d7d76-f182-43f3-99aa-d9833c772100" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.106135] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "port-236d7d76-f182-43f3-99aa-d9833c772100" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.106135] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "port-236d7d76-f182-43f3-99aa-d9833c772100" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.106135] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('236d7d76-f182-43f3-99aa-d9833c772100',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.224132] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3ece2d85-d26d-4c59-ae47-b9a59cc4de8f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.320033] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-6745d4e2-6069-4132-80d9-76cf2245b017 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.321516] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6745d4e2-6069-4132-80d9-76cf2245b017" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.321655] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6745d4e2-6069-4132-80d9-76cf2245b017" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.321952] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6745d4e2-6069-4132-80d9-76cf2245b017" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.322274] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.322423] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.322515] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.323800] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.323800] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.323800] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6745d4e2-6069-4132-80d9-76cf2245b017" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.323800] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-6745d4e2-6069-4132-80d9-76cf2245b017 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.323800] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6745d4e2-6069-4132-80d9-76cf2245b017" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.323800] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6745d4e2-6069-4132-80d9-76cf2245b017" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.323800] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6745d4e2-6069-4132-80d9-76cf2245b017" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.323800] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.324179] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.324479] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.325202] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.325202] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.325202] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6745d4e2-6069-4132-80d9-76cf2245b017" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.325202] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6745d4e2-6069-4132-80d9-76cf2245b017',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.332366] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.332366] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.332366] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.332366] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.332366] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.332366] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 529c6563-9354-49e2-8282-acd28e0b0ef7 is going to be created. [ 954.357491] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.358361] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.358430] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.359028] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.359028] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.371587] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 529c6563-9354-49e2-8282-acd28e0b0ef7 in Status: UNINITIALIZED for 2s [ 954.610030] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.610030] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.610210] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.610530] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.610683] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.610836] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Segment Port 236d7d76-f182-43f3-99aa-d9833c772100 not found, creating... [ 954.611105] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.611261] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.611381] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.611628] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.611771] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.612090] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.612218] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.612331] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.612535] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.612664] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.612798] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Resource: SegmentPort with ID: 236d7d76-f182-43f3-99aa-d9833c772100 is going to be created. [ 954.632744] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.632981] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.633153] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.633401] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.633633] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.633858] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "port-236d7d76-f182-43f3-99aa-d9833c772100" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.727695] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3ece2d85-d26d-4c59-ae47-b9a59cc4de8f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 954.832131] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6745d4e2-6069-4132-80d9-76cf2245b017: rpc.has_security_group_logging(os_id): False [ 954.852870] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.853110] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.853187] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.853425] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.853502] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.853655] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.853754] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.853808] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.853962] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.854067] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.854245] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.854355] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.854469] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.854538] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.854607] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.854798] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.854893] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.854965] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.855108] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.855175] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.855262] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6745d4e2-6069-4132-80d9-76cf2245b017 is going to be created. [ 954.924753] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 954.924989] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 954.924989] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 954.925212] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 954.925379] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 954.937844] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6745d4e2-6069-4132-80d9-76cf2245b017 in Status: IN_PROGRESS for 2s [ 955.230683] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.230874] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.230951] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.231361] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.231361] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.231504] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ece2d85-d26d-4c59-ae47-b9a59cc4de8f is going to be updated. [ 955.296200] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.296371] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.296456] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.296716] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.296877] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.318038] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ece2d85-d26d-4c59-ae47-b9a59cc4de8f in Status: IN_PROGRESS for 2s [ 955.382744] env[67094]: INFO networking_nsxv3.common.synchronization [req-f3982418-d24e-433f-9831-55abfd48d552 req-5b4db343-e2fb-40ff-bfc1-e6ef0c543485 service nova] Enqueued Resource ID: 3ece2d85-d26d-4c59-ae47-b9a59cc4de8f with Priority: HIGHEST for action security_group_rules [ 955.382936] env[67094]: INFO networking_nsxv3.common.synchronization [req-f3982418-d24e-433f-9831-55abfd48d552 req-5b4db343-e2fb-40ff-bfc1-e6ef0c543485 service nova] Enqueued Resource ID: 3ece2d85-d26d-4c59-ae47-b9a59cc4de8f with Priority: HIGHEST for action security_group_members [ 955.383086] env[67094]: INFO networking_nsxv3.common.synchronization [req-f3982418-d24e-433f-9831-55abfd48d552 req-5b4db343-e2fb-40ff-bfc1-e6ef0c543485 service nova] Enqueued Resource ID: 236d7d76-f182-43f3-99aa-d9833c772100 with Priority: HIGHEST for action port [ 955.385344] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 60943622-73b5-4dda-ad21-63bf08db617e in Status: SUCCESS [ 955.385650] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 60943622-73b5-4dda-ad21-63bf08db617e deletion is rescheduled due to dependency. [ 955.385808] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-60943622-73b5-4dda-ad21-63bf08db617e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.386422] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ece2d85-d26d-4c59-ae47-b9a59cc4de8f with Priority: HIGHEST for action security_group_rules [ 955.386617] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ece2d85-d26d-4c59-ae47-b9a59cc4de8f with Priority: HIGHEST for action security_group_members [ 955.387143] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 236d7d76-f182-43f3-99aa-d9833c772100 with Priority: HIGHEST for action port [ 955.387495] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3ece2d85-d26d-4c59-ae47-b9a59cc4de8f taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.387646] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3ece2d85-d26d-4c59-ae47-b9a59cc4de8f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.387734] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3ece2d85-d26d-4c59-ae47-b9a59cc4de8f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.387992] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3ece2d85-d26d-4c59-ae47-b9a59cc4de8f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.388123] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3ece2d85-d26d-4c59-ae47-b9a59cc4de8f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.389218] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ece2d85-d26d-4c59-ae47-b9a59cc4de8f taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.389329] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ece2d85-d26d-4c59-ae47-b9a59cc4de8f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.389610] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-236d7d76-f182-43f3-99aa-d9833c772100 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.389723] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-236d7d76-f182-43f3-99aa-d9833c772100" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.389788] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-236d7d76-f182-43f3-99aa-d9833c772100" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.389971] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-236d7d76-f182-43f3-99aa-d9833c772100" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.390076] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('236d7d76-f182-43f3-99aa-d9833c772100',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 955.896035] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ece2d85-d26d-4c59-ae47-b9a59cc4de8f taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.896035] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ece2d85-d26d-4c59-ae47-b9a59cc4de8f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.896035] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 236d7d76-f182-43f3-99aa-d9833c772100 with status ACTIVE [ 955.896035] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.896035] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.896035] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.896035] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.896035] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.896035] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.896035] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.896035] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.896035] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.896035] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.896035] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.896893] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.896893] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.896893] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.896893] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.896893] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 236d7d76-f182-43f3-99aa-d9833c772100 is going to be updated. [ 955.920750] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 955.920750] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 955.920750] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 955.921069] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 955.921069] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 955.921326] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-236d7d76-f182-43f3-99aa-d9833c772100" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.385140] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 529c6563-9354-49e2-8282-acd28e0b0ef7 in Status: SUCCESS [ 956.385404] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-529c6563-9354-49e2-8282-acd28e0b0ef7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.385562] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-529c6563-9354-49e2-8282-acd28e0b0ef7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.385830] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-529c6563-9354-49e2-8282-acd28e0b0ef7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.385995] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.386133] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.386217] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.386402] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.386515] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.386681] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-529c6563-9354-49e2-8282-acd28e0b0ef7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.386681] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('529c6563-9354-49e2-8282-acd28e0b0ef7',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.466451] env[67094]: INFO networking_nsxv3.common.synchronization [req-26dbc877-137e-4966-90ae-d9d229110360 req-28468b83-104d-45bd-874c-dd68797f29eb tempest-ImagesOneServerNegativeTestJSON-1967011174 tempest-ImagesOneServerNegativeTestJSON-1967011174-project-member] Enqueued Resource ID: 71aa8195-5281-4a1c-b9a7-3d40e851f47e with Priority: HIGHEST for action security_group_members [ 956.467627] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71aa8195-5281-4a1c-b9a7-3d40e851f47e with Priority: HIGHEST for action security_group_members [ 956.468059] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-71aa8195-5281-4a1c-b9a7-3d40e851f47e taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.468193] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.468259] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.468463] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.468615] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.468774] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.468774] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.468907] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.468987] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.471025] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('71aa8195-5281-4a1c-b9a7-3d40e851f47e',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.879292] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock network-578 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.879517] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "network-578" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.879652] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "network-578" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.879944] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "network-578" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.880439] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.880439] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.880560] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.880782] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.880925] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.881158] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 956.881284] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 956.881875] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 956.881875] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 956.881875] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 956.881875] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 956.881875] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 956.889449] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('529c6563-9354-49e2-8282-acd28e0b0ef7',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.903903] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 956.904190] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 956.904293] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 956.904405] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "network-578" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.904730] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock port-ce033f5b-f80c-44a8-80b5-50bd1a0ff957 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.904905] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "port-ce033f5b-f80c-44a8-80b5-50bd1a0ff957" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.905032] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "port-ce033f5b-f80c-44a8-80b5-50bd1a0ff957" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.905353] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "port-ce033f5b-f80c-44a8-80b5-50bd1a0ff957" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.905494] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce033f5b-f80c-44a8-80b5-50bd1a0ff957',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 956.952932] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6745d4e2-6069-4132-80d9-76cf2245b017 in Status: SUCCESS [ 956.953176] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6745d4e2-6069-4132-80d9-76cf2245b017" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.973333] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.973503] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.973556] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.973783] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.998239] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.998692] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 956.998933] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 956.999069] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 956.999408] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 956.999549] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 956.999697] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71aa8195-5281-4a1c-b9a7-3d40e851f47e is going to be updated. [ 957.028197] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.028438] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.028521] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.028754] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.028912] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.043145] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71aa8195-5281-4a1c-b9a7-3d40e851f47e in Status: IN_PROGRESS for 2s [ 957.339568] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ece2d85-d26d-4c59-ae47-b9a59cc4de8f in Status: SUCCESS [ 957.339804] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ece2d85-d26d-4c59-ae47-b9a59cc4de8f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.340029] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ece2d85-d26d-4c59-ae47-b9a59cc4de8f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.340272] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ece2d85-d26d-4c59-ae47-b9a59cc4de8f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.341055] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.341055] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.341055] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.341055] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.341055] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.341055] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ece2d85-d26d-4c59-ae47-b9a59cc4de8f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 957.391946] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 529c6563-9354-49e2-8282-acd28e0b0ef7: rpc.has_security_group_logging(os_id): False [ 957.415273] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.415392] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.415579] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.415915] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.416149] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.416315] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Segment Port ce033f5b-f80c-44a8-80b5-50bd1a0ff957 not found, creating... [ 957.416600] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.416851] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.417022] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.417289] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.417489] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.417795] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.417953] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.418079] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.418323] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.418458] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.418595] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Resource: SegmentPort with ID: ce033f5b-f80c-44a8-80b5-50bd1a0ff957 is going to be created. [ 957.420581] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.420700] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.420755] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.420912] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.420990] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.421225] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.421322] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.421382] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.421524] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.421596] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.421679] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 529c6563-9354-49e2-8282-acd28e0b0ef7 is going to be created. [ 957.443964] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.444165] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.444263] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.444609] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.444873] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.445146] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "port-ce033f5b-f80c-44a8-80b5-50bd1a0ff957" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.500997] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 957.500997] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 957.500997] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 957.500997] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 957.500997] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 957.533456] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 529c6563-9354-49e2-8282-acd28e0b0ef7 in Status: IN_PROGRESS for 2s [ 957.842809] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3ece2d85-d26d-4c59-ae47-b9a59cc4de8f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.186387] env[67094]: INFO networking_nsxv3.common.synchronization [req-26dbc877-137e-4966-90ae-d9d229110360 req-ffb91593-e3aa-42ba-9bc4-a7679cb441b9 service nova] Enqueued Resource ID: 71aa8195-5281-4a1c-b9a7-3d40e851f47e with Priority: HIGHEST for action security_group_rules [ 958.187066] env[67094]: INFO networking_nsxv3.common.synchronization [req-26dbc877-137e-4966-90ae-d9d229110360 req-ffb91593-e3aa-42ba-9bc4-a7679cb441b9 service nova] Enqueued Resource ID: 71aa8195-5281-4a1c-b9a7-3d40e851f47e with Priority: HIGHEST for action security_group_members [ 958.187370] env[67094]: INFO networking_nsxv3.common.synchronization [req-26dbc877-137e-4966-90ae-d9d229110360 req-ffb91593-e3aa-42ba-9bc4-a7679cb441b9 service nova] Enqueued Resource ID: ce033f5b-f80c-44a8-80b5-50bd1a0ff957 with Priority: HIGHEST for action port [ 958.188264] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71aa8195-5281-4a1c-b9a7-3d40e851f47e with Priority: HIGHEST for action security_group_rules [ 958.190318] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71aa8195-5281-4a1c-b9a7-3d40e851f47e with Priority: HIGHEST for action security_group_members [ 958.190318] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce033f5b-f80c-44a8-80b5-50bd1a0ff957 with Priority: HIGHEST for action port [ 958.190318] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-71aa8195-5281-4a1c-b9a7-3d40e851f47e taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.190318] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.190318] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.190318] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.190318] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('71aa8195-5281-4a1c-b9a7-3d40e851f47e',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.191653] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-71aa8195-5281-4a1c-b9a7-3d40e851f47e taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.191653] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.191653] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-ce033f5b-f80c-44a8-80b5-50bd1a0ff957 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.191960] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ce033f5b-f80c-44a8-80b5-50bd1a0ff957" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.192358] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ce033f5b-f80c-44a8-80b5-50bd1a0ff957" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.192612] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ce033f5b-f80c-44a8-80b5-50bd1a0ff957" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.192727] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce033f5b-f80c-44a8-80b5-50bd1a0ff957',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.346493] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3ece2d85-d26d-4c59-ae47-b9a59cc4de8f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 958.695406] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-71aa8195-5281-4a1c-b9a7-3d40e851f47e taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.695640] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.696984] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ce033f5b-f80c-44a8-80b5-50bd1a0ff957 with status ACTIVE [ 958.697524] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.697657] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.697769] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.697958] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.698148] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.698257] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.698362] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.698425] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.698610] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.698681] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.698833] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.698955] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.699191] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.699191] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.699280] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.699310] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ce033f5b-f80c-44a8-80b5-50bd1a0ff957 is going to be updated. [ 958.727441] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.727677] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.727756] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.730023] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.730023] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.730023] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ce033f5b-f80c-44a8-80b5-50bd1a0ff957" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.849403] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.849808] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.849808] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.850032] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.850128] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.850661] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ece2d85-d26d-4c59-ae47-b9a59cc4de8f is going to be updated. [ 958.885454] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 958.885454] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 958.885454] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 958.885787] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 958.886022] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 958.896912] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ece2d85-d26d-4c59-ae47-b9a59cc4de8f in Status: IN_PROGRESS for 2s [ 959.054612] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71aa8195-5281-4a1c-b9a7-3d40e851f47e in Status: SUCCESS [ 959.054880] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71aa8195-5281-4a1c-b9a7-3d40e851f47e deletion is rescheduled due to dependency. [ 959.055841] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.055841] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.055841] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.055841] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.055841] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.055841] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.055841] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.056191] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.056191] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('71aa8195-5281-4a1c-b9a7-3d40e851f47e',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.086056] env[67094]: INFO networking_nsxv3.common.synchronization [req-5649d657-af32-4cc9-82dd-4afb9ca6fae6 req-a899c61b-079a-4dfe-bdc8-3cd290993c02 tempest-ServersNegativeTestMultiTenantJSON-1217348700 tempest-ServersNegativeTestMultiTenantJSON-1217348700-project-member] Enqueued Resource ID: a9f3a2fb-a15a-4ea6-a2e4-0a89b6b14559 with Priority: HIGHEST for action security_group_members [ 959.086609] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9f3a2fb-a15a-4ea6-a2e4-0a89b6b14559 with Priority: HIGHEST for action security_group_members [ 959.087129] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9f3a2fb-a15a-4ea6-a2e4-0a89b6b14559 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.087302] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9f3a2fb-a15a-4ea6-a2e4-0a89b6b14559" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.087409] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9f3a2fb-a15a-4ea6-a2e4-0a89b6b14559" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.087733] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9f3a2fb-a15a-4ea6-a2e4-0a89b6b14559" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.087901] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.088034] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.088077] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.088228] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.088311] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.088407] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9f3a2fb-a15a-4ea6-a2e4-0a89b6b14559',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.441639] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock network-751 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.442081] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "network-751" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.442081] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "network-751" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.442363] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "network-751" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.442664] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.442831] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.442948] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.443305] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.443582] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.443821] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 959.444489] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 959.445290] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 959.445514] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 959.446253] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 959.446488] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 959.446662] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 959.468985] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 959.469254] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 959.469461] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 959.469664] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "network-751" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.470032] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock port-e9d26241-64c4-4938-a698-6eaedb9993f3 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.470278] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "port-e9d26241-64c4-4938-a698-6eaedb9993f3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.470408] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "port-e9d26241-64c4-4938-a698-6eaedb9993f3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.470781] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "port-e9d26241-64c4-4938-a698-6eaedb9993f3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.470869] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9d26241-64c4-4938-a698-6eaedb9993f3',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.546668] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 529c6563-9354-49e2-8282-acd28e0b0ef7 in Status: SUCCESS [ 959.546929] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-529c6563-9354-49e2-8282-acd28e0b0ef7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.558024] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('71aa8195-5281-4a1c-b9a7-3d40e851f47e',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 959.592574] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.592574] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.592574] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.592574] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.592574] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.592972] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.592972] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.592972] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.593136] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.593136] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.593238] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9f3a2fb-a15a-4ea6-a2e4-0a89b6b14559 already deleted. [ 959.593303] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9f3a2fb-a15a-4ea6-a2e4-0a89b6b14559" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.976961] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.977287] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.977391] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.977665] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.977821] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.977978] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Segment Port e9d26241-64c4-4938-a698-6eaedb9993f3 not found, creating... [ 959.978271] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.978441] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.978557] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.978896] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.978982] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.979364] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 959.979538] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 959.979655] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 959.979869] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 959.980013] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 959.980165] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Resource: SegmentPort with ID: e9d26241-64c4-4938-a698-6eaedb9993f3 is going to be created. [ 960.006216] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.006468] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.006596] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.006921] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.007190] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.007428] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "port-e9d26241-64c4-4938-a698-6eaedb9993f3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.061297] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('71aa8195-5281-4a1c-b9a7-3d40e851f47e',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.564571] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.564914] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.564914] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.565175] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.565272] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.565391] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71aa8195-5281-4a1c-b9a7-3d40e851f47e is going to be updated. [ 960.613242] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.613510] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.613600] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.616042] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.616283] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.627411] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71aa8195-5281-4a1c-b9a7-3d40e851f47e in Status: IN_PROGRESS for 2s [ 960.831233] env[67094]: INFO networking_nsxv3.common.synchronization [req-5649d657-af32-4cc9-82dd-4afb9ca6fae6 req-cdda48f5-033a-4a0a-96b4-01fdf88751b5 service nova] Enqueued Resource ID: a9f3a2fb-a15a-4ea6-a2e4-0a89b6b14559 with Priority: HIGHEST for action security_group_rules [ 960.831606] env[67094]: INFO networking_nsxv3.common.synchronization [req-5649d657-af32-4cc9-82dd-4afb9ca6fae6 req-cdda48f5-033a-4a0a-96b4-01fdf88751b5 service nova] Enqueued Resource ID: a9f3a2fb-a15a-4ea6-a2e4-0a89b6b14559 with Priority: HIGHEST for action security_group_members [ 960.831606] env[67094]: INFO networking_nsxv3.common.synchronization [req-5649d657-af32-4cc9-82dd-4afb9ca6fae6 req-cdda48f5-033a-4a0a-96b4-01fdf88751b5 service nova] Enqueued Resource ID: e9d26241-64c4-4938-a698-6eaedb9993f3 with Priority: HIGHEST for action port [ 960.832224] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9f3a2fb-a15a-4ea6-a2e4-0a89b6b14559 with Priority: HIGHEST for action security_group_rules [ 960.832378] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9f3a2fb-a15a-4ea6-a2e4-0a89b6b14559 with Priority: HIGHEST for action security_group_members [ 960.832487] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e9d26241-64c4-4938-a698-6eaedb9993f3 with Priority: HIGHEST for action port [ 960.832816] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a9f3a2fb-a15a-4ea6-a2e4-0a89b6b14559 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.832952] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a9f3a2fb-a15a-4ea6-a2e4-0a89b6b14559" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.833110] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a9f3a2fb-a15a-4ea6-a2e4-0a89b6b14559" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.833326] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a9f3a2fb-a15a-4ea6-a2e4-0a89b6b14559" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.833484] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a9f3a2fb-a15a-4ea6-a2e4-0a89b6b14559',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.834425] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9f3a2fb-a15a-4ea6-a2e4-0a89b6b14559 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.834564] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9f3a2fb-a15a-4ea6-a2e4-0a89b6b14559" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.834687] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9f3a2fb-a15a-4ea6-a2e4-0a89b6b14559" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.834934] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9f3a2fb-a15a-4ea6-a2e4-0a89b6b14559" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.835020] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.835093] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.835461] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.835461] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.835461] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.835461] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9f3a2fb-a15a-4ea6-a2e4-0a89b6b14559',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.837033] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-e9d26241-64c4-4938-a698-6eaedb9993f3 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.837033] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e9d26241-64c4-4938-a698-6eaedb9993f3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.837033] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e9d26241-64c4-4938-a698-6eaedb9993f3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.837033] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e9d26241-64c4-4938-a698-6eaedb9993f3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.837033] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e9d26241-64c4-4938-a698-6eaedb9993f3',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 960.906735] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ece2d85-d26d-4c59-ae47-b9a59cc4de8f in Status: SUCCESS [ 960.906960] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ece2d85-d26d-4c59-ae47-b9a59cc4de8f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.907171] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ece2d85-d26d-4c59-ae47-b9a59cc4de8f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.907554] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ece2d85-d26d-4c59-ae47-b9a59cc4de8f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.908454] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 960.908638] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 960.908756] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 960.909559] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 960.909559] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.909559] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ece2d85-d26d-4c59-ae47-b9a59cc4de8f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 960.909559] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3ece2d85-d26d-4c59-ae47-b9a59cc4de8f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.339825] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('a9f3a2fb-a15a-4ea6-a2e4-0a89b6b14559',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.340727] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9f3a2fb-a15a-4ea6-a2e4-0a89b6b14559 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.340896] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9f3a2fb-a15a-4ea6-a2e4-0a89b6b14559" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.341028] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e9d26241-64c4-4938-a698-6eaedb9993f3 with status ACTIVE [ 961.341194] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.341310] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.341410] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.341638] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.341741] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.342141] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.342141] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.342141] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.342360] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.342360] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.342500] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.342584] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.342645] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.342782] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.342856] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.342952] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e9d26241-64c4-4938-a698-6eaedb9993f3 is going to be updated. [ 961.377923] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.377923] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.378120] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.378265] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.378412] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.378579] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e9d26241-64c4-4938-a698-6eaedb9993f3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.415313] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ece2d85-d26d-4c59-ae47-b9a59cc4de8f taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.415313] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ece2d85-d26d-4c59-ae47-b9a59cc4de8f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.415313] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ece2d85-d26d-4c59-ae47-b9a59cc4de8f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.415313] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ece2d85-d26d-4c59-ae47-b9a59cc4de8f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.415313] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.415313] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.415313] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.415313] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.415313] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.415313] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ece2d85-d26d-4c59-ae47-b9a59cc4de8f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.415313] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ece2d85-d26d-4c59-ae47-b9a59cc4de8f taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.415313] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ece2d85-d26d-4c59-ae47-b9a59cc4de8f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.415313] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ece2d85-d26d-4c59-ae47-b9a59cc4de8f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.415313] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ece2d85-d26d-4c59-ae47-b9a59cc4de8f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.415313] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.415313] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.416296] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.416296] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.416296] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.416296] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ece2d85-d26d-4c59-ae47-b9a59cc4de8f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.416296] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3ece2d85-d26d-4c59-ae47-b9a59cc4de8f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.845982] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('a9f3a2fb-a15a-4ea6-a2e4-0a89b6b14559',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 961.917838] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3ece2d85-d26d-4c59-ae47-b9a59cc4de8f: rpc.has_security_group_logging(os_id): False [ 961.947361] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.947519] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.947590] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.947800] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.970834] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.971137] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.971243] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.971306] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.971501] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.971587] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.971785] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.972608] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.972608] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.972608] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.972608] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.972608] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 961.972608] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 961.972608] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 961.972608] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 961.973100] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 961.973100] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3ece2d85-d26d-4c59-ae47-b9a59cc4de8f is going to be updated. [ 962.041598] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.041767] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.041827] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.042050] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.042248] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.061796] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ece2d85-d26d-4c59-ae47-b9a59cc4de8f in Status: IN_PROGRESS for 2s [ 962.351741] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.351905] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.351980] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.352218] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.352316] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.354290] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9f3a2fb-a15a-4ea6-a2e4-0a89b6b14559 is going to be created. [ 962.376482] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.376768] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.376866] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.377222] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.377455] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.387920] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9f3a2fb-a15a-4ea6-a2e4-0a89b6b14559 in Status: UNINITIALIZED for 2s [ 962.638066] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71aa8195-5281-4a1c-b9a7-3d40e851f47e in Status: SUCCESS [ 962.638339] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.639012] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.639012] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.639153] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 962.639443] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 962.639443] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 962.639578] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 962.639633] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.639873] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 962.639873] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('71aa8195-5281-4a1c-b9a7-3d40e851f47e',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.142895] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-71aa8195-5281-4a1c-b9a7-3d40e851f47e taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.142895] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.142895] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.143439] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.143439] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.143439] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.143439] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.143651] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.143687] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.143787] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.143970] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-71aa8195-5281-4a1c-b9a7-3d40e851f47e taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.144072] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.144154] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.144295] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.144489] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.144589] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.144663] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.144809] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.144884] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.144981] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.145085] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('71aa8195-5281-4a1c-b9a7-3d40e851f47e',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 963.647321] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 71aa8195-5281-4a1c-b9a7-3d40e851f47e: rpc.has_security_group_logging(os_id): False [ 963.668843] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.669121] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.669277] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.669571] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.669723] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.670085] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.670262] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.670401] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.670587] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.670968] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.670968] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.671202] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.671318] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.671547] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.671652] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.671895] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.672032] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.672151] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.672362] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.672538] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.672625] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 71aa8195-5281-4a1c-b9a7-3d40e851f47e is going to be updated. [ 963.747747] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 963.748290] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 963.748455] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 963.748817] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 963.750021] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 963.766613] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 71aa8195-5281-4a1c-b9a7-3d40e851f47e in Status: IN_PROGRESS for 2s [ 964.073873] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3ece2d85-d26d-4c59-ae47-b9a59cc4de8f in Status: SUCCESS [ 964.073873] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3ece2d85-d26d-4c59-ae47-b9a59cc4de8f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.398996] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9f3a2fb-a15a-4ea6-a2e4-0a89b6b14559 in Status: SUCCESS [ 964.399367] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9f3a2fb-a15a-4ea6-a2e4-0a89b6b14559" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.399556] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9f3a2fb-a15a-4ea6-a2e4-0a89b6b14559" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.399816] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9f3a2fb-a15a-4ea6-a2e4-0a89b6b14559" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.400057] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.400220] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.400284] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.400438] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.400559] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.400695] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9f3a2fb-a15a-4ea6-a2e4-0a89b6b14559" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.400849] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('a9f3a2fb-a15a-4ea6-a2e4-0a89b6b14559',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.903493] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9f3a2fb-a15a-4ea6-a2e4-0a89b6b14559 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.903654] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9f3a2fb-a15a-4ea6-a2e4-0a89b6b14559" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.903728] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9f3a2fb-a15a-4ea6-a2e4-0a89b6b14559" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.903943] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9f3a2fb-a15a-4ea6-a2e4-0a89b6b14559" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.904124] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.904234] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.904299] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.904451] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.904540] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.904627] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9f3a2fb-a15a-4ea6-a2e4-0a89b6b14559" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.904769] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9f3a2fb-a15a-4ea6-a2e4-0a89b6b14559 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.904874] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9f3a2fb-a15a-4ea6-a2e4-0a89b6b14559" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.904910] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9f3a2fb-a15a-4ea6-a2e4-0a89b6b14559" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.905068] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9f3a2fb-a15a-4ea6-a2e4-0a89b6b14559" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.905207] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.905296] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.905352] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.905485] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.905560] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.905642] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9f3a2fb-a15a-4ea6-a2e4-0a89b6b14559" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.905981] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('a9f3a2fb-a15a-4ea6-a2e4-0a89b6b14559',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 964.963544] env[67094]: INFO networking_nsxv3.common.synchronization [req-6d885b1a-e385-44b3-9302-33d3251a7b7b req-3ccb9d04-da23-4a3f-aff9-2c3a5137e860 tempest-ImagesTestJSON-2097058733 tempest-ImagesTestJSON-2097058733-project-member] Enqueued Resource ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa with Priority: HIGHEST for action security_group_members [ 964.963739] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa with Priority: HIGHEST for action security_group_members [ 964.963999] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-84918628-8f8e-4d25-9c0f-17cccb58ebfa taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.964135] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.964194] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.964428] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.964579] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 964.966013] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 964.966013] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 964.966013] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 964.966013] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 964.966013] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('84918628-8f8e-4d25-9c0f-17cccb58ebfa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 965.408012] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for a9f3a2fb-a15a-4ea6-a2e4-0a89b6b14559: rpc.has_security_group_logging(os_id): False [ 965.430255] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.430440] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.430513] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.430750] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.430848] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.431068] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.431169] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.431256] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.432183] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.432183] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.432183] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.432183] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.432183] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.432183] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.432183] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.432482] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.432482] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.432482] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.432753] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.432753] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.432840] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a9f3a2fb-a15a-4ea6-a2e4-0a89b6b14559 is going to be created. [ 965.468568] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.468568] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.468568] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.469411] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.469411] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.469411] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.469411] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.469411] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.469812] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.469812] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.469812] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa is going to be updated. [ 965.524607] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.524850] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.524968] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.525336] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.525584] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.537199] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa in Status: IN_PROGRESS for 2s [ 965.540860] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 965.541165] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 965.541165] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 965.541350] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 965.541597] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 965.556181] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9f3a2fb-a15a-4ea6-a2e4-0a89b6b14559 in Status: IN_PROGRESS for 2s [ 965.782533] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 71aa8195-5281-4a1c-b9a7-3d40e851f47e in Status: SUCCESS [ 965.782779] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.550400] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa in Status: SUCCESS [ 967.550400] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa deletion is rescheduled due to dependency. [ 967.550400] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.571808] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: a9f3a2fb-a15a-4ea6-a2e4-0a89b6b14559 in Status: SUCCESS [ 967.572096] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a9f3a2fb-a15a-4ea6-a2e4-0a89b6b14559" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 967.624939] env[67094]: INFO networking_nsxv3.common.synchronization [None req-e9256867-c3b2-4267-a845-8dcd153fb6bd None None] Enqueued Resource ID: fdd4b44e-68d8-404e-9f72-a1d2bd4e5f7d with Priority: HIGHEST for action port [ 967.625719] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fdd4b44e-68d8-404e-9f72-a1d2bd4e5f7d with Priority: HIGHEST for action port [ 967.626592] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-fdd4b44e-68d8-404e-9f72-a1d2bd4e5f7d taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 967.626592] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fdd4b44e-68d8-404e-9f72-a1d2bd4e5f7d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 967.626592] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fdd4b44e-68d8-404e-9f72-a1d2bd4e5f7d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 967.627037] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fdd4b44e-68d8-404e-9f72-a1d2bd4e5f7d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 967.627237] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fdd4b44e-68d8-404e-9f72-a1d2bd4e5f7d',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 968.130042] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fdd4b44e-68d8-404e-9f72-a1d2bd4e5f7d [ 968.130469] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 968.130662] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 968.130770] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 968.131274] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 968.131431] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 968.131615] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fdd4b44e-68d8-404e-9f72-a1d2bd4e5f7d already deleted. [ 968.131753] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fdd4b44e-68d8-404e-9f72-a1d2bd4e5f7d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.236884] env[67094]: INFO networking_nsxv3.common.synchronization [req-f2685dd4-af4e-42ca-8cd1-c2348c62d31a req-2ab33ff8-e750-4212-abad-a538e66a52fc tempest-ServerActionsTestJSON-785713127 tempest-ServerActionsTestJSON-785713127-project-member] Enqueued Resource ID: 5d6b6e19-f017-4eac-b0ac-ed1b17230d12 with Priority: HIGHEST for action security_group_members [ 969.237310] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d6b6e19-f017-4eac-b0ac-ed1b17230d12 with Priority: HIGHEST for action security_group_members [ 969.237590] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d6b6e19-f017-4eac-b0ac-ed1b17230d12 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.237710] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d6b6e19-f017-4eac-b0ac-ed1b17230d12" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.237780] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d6b6e19-f017-4eac-b0ac-ed1b17230d12" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.238399] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d6b6e19-f017-4eac-b0ac-ed1b17230d12" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.238552] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.238662] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.238727] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.239011] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.239112] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.239208] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d6b6e19-f017-4eac-b0ac-ed1b17230d12',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 969.742496] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.742496] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.742496] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.742496] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.742496] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.742496] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.742496] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.742828] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.742828] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.742828] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.742935] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d6b6e19-f017-4eac-b0ac-ed1b17230d12 already deleted. [ 969.742935] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d6b6e19-f017-4eac-b0ac-ed1b17230d12" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.745199] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock network-657 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.745199] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "network-657" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.745550] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "network-657" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.745807] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "network-657" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.746094] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.747044] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.747044] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.747044] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.747044] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.747261] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 969.747484] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 969.747632] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 969.747780] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 969.747856] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 969.747965] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 969.748107] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 969.769403] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 969.769954] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 969.769954] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 969.769954] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "network-657" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 969.770296] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock port-72a83ce7-7fae-413f-b4dc-2926b9842d38 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 969.770470] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "port-72a83ce7-7fae-413f-b4dc-2926b9842d38" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 969.770587] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "port-72a83ce7-7fae-413f-b4dc-2926b9842d38" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 969.770917] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "port-72a83ce7-7fae-413f-b4dc-2926b9842d38" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 969.771085] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72a83ce7-7fae-413f-b4dc-2926b9842d38',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.060272] env[67094]: INFO networking_nsxv3.common.synchronization [None req-888670a6-97b8-449d-9bc4-797da391ad5b None None] Enqueued Resource ID: 50c709cf-4bce-4334-8038-3980e342359e with Priority: HIGHEST for action port [ 970.061080] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 50c709cf-4bce-4334-8038-3980e342359e with Priority: HIGHEST for action port [ 970.061241] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-50c709cf-4bce-4334-8038-3980e342359e taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.061438] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-50c709cf-4bce-4334-8038-3980e342359e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.061572] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-50c709cf-4bce-4334-8038-3980e342359e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.062018] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-50c709cf-4bce-4334-8038-3980e342359e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.062018] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('50c709cf-4bce-4334-8038-3980e342359e',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 970.274445] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.274969] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.274969] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.275321] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.275414] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.276750] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Segment Port 72a83ce7-7fae-413f-b4dc-2926b9842d38 not found, creating... [ 970.276750] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.276750] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.276750] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.276750] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.276750] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.277074] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.277074] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.277312] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.277355] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.277477] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.277632] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Resource: SegmentPort with ID: 72a83ce7-7fae-413f-b4dc-2926b9842d38 is going to be created. [ 970.306249] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.306563] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.306724] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.307109] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.307455] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.307760] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "port-72a83ce7-7fae-413f-b4dc-2926b9842d38" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.566189] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 50c709cf-4bce-4334-8038-3980e342359e [ 970.566189] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 970.566189] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 970.566483] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 970.566483] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 970.566544] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 970.567195] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:50c709cf-4bce-4334-8038-3980e342359e already deleted. [ 970.567195] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-50c709cf-4bce-4334-8038-3980e342359e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.020206] env[67094]: INFO networking_nsxv3.common.synchronization [req-f2685dd4-af4e-42ca-8cd1-c2348c62d31a req-1df057e6-a214-4d37-b978-edd6e198465c service nova] Enqueued Resource ID: 5d6b6e19-f017-4eac-b0ac-ed1b17230d12 with Priority: HIGHEST for action security_group_rules [ 971.020384] env[67094]: INFO networking_nsxv3.common.synchronization [req-f2685dd4-af4e-42ca-8cd1-c2348c62d31a req-1df057e6-a214-4d37-b978-edd6e198465c service nova] Enqueued Resource ID: 5d6b6e19-f017-4eac-b0ac-ed1b17230d12 with Priority: HIGHEST for action security_group_members [ 971.020520] env[67094]: INFO networking_nsxv3.common.synchronization [req-f2685dd4-af4e-42ca-8cd1-c2348c62d31a req-1df057e6-a214-4d37-b978-edd6e198465c service nova] Enqueued Resource ID: 72a83ce7-7fae-413f-b4dc-2926b9842d38 with Priority: HIGHEST for action port [ 971.023430] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d6b6e19-f017-4eac-b0ac-ed1b17230d12 with Priority: HIGHEST for action security_group_rules [ 971.023430] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d6b6e19-f017-4eac-b0ac-ed1b17230d12 with Priority: HIGHEST for action security_group_members [ 971.023430] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 72a83ce7-7fae-413f-b4dc-2926b9842d38 with Priority: HIGHEST for action port [ 971.023430] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5d6b6e19-f017-4eac-b0ac-ed1b17230d12 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.023430] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5d6b6e19-f017-4eac-b0ac-ed1b17230d12" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.023430] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5d6b6e19-f017-4eac-b0ac-ed1b17230d12" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.023430] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5d6b6e19-f017-4eac-b0ac-ed1b17230d12" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.023430] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5d6b6e19-f017-4eac-b0ac-ed1b17230d12',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.023430] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d6b6e19-f017-4eac-b0ac-ed1b17230d12 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.023430] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d6b6e19-f017-4eac-b0ac-ed1b17230d12" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.023430] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d6b6e19-f017-4eac-b0ac-ed1b17230d12" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.024090] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d6b6e19-f017-4eac-b0ac-ed1b17230d12" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.024090] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.024090] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.024090] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.024090] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.024090] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.024297] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d6b6e19-f017-4eac-b0ac-ed1b17230d12',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.025726] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-72a83ce7-7fae-413f-b4dc-2926b9842d38 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.025855] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-72a83ce7-7fae-413f-b4dc-2926b9842d38" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.025933] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-72a83ce7-7fae-413f-b4dc-2926b9842d38" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.026080] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-72a83ce7-7fae-413f-b4dc-2926b9842d38" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.026178] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('72a83ce7-7fae-413f-b4dc-2926b9842d38',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.410252] env[67094]: INFO networking_nsxv3.common.synchronization [None req-6e8cb27c-28a6-453c-96be-5b2f76d18c7d None None] Enqueued Resource ID: 45c2227b-b576-46b5-82a2-eb40b60a65d0 with Priority: HIGHEST for action port [ 971.414592] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 45c2227b-b576-46b5-82a2-eb40b60a65d0 with Priority: HIGHEST for action port [ 971.415045] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-45c2227b-b576-46b5-82a2-eb40b60a65d0 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.415226] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-45c2227b-b576-46b5-82a2-eb40b60a65d0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.415359] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-45c2227b-b576-46b5-82a2-eb40b60a65d0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.415676] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-45c2227b-b576-46b5-82a2-eb40b60a65d0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.415761] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('45c2227b-b576-46b5-82a2-eb40b60a65d0',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.528679] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d6b6e19-f017-4eac-b0ac-ed1b17230d12 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.528848] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d6b6e19-f017-4eac-b0ac-ed1b17230d12" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.529193] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('5d6b6e19-f017-4eac-b0ac-ed1b17230d12',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 971.530159] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 72a83ce7-7fae-413f-b4dc-2926b9842d38 with status ACTIVE [ 971.530375] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.530499] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.530562] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.531322] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.531322] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.531322] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.531322] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.531322] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.531322] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.531594] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.531594] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.531680] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.531761] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.531944] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.532030] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.532118] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 72a83ce7-7fae-413f-b4dc-2926b9842d38 is going to be updated. [ 971.555544] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.555716] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.555997] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.556728] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.556952] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.557262] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-72a83ce7-7fae-413f-b4dc-2926b9842d38" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.920189] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 45c2227b-b576-46b5-82a2-eb40b60a65d0 [ 971.920451] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 971.920588] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 971.920657] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 971.920869] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 971.920956] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 971.921128] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:45c2227b-b576-46b5-82a2-eb40b60a65d0 already deleted. [ 971.921238] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-45c2227b-b576-46b5-82a2-eb40b60a65d0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.034426] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('5d6b6e19-f017-4eac-b0ac-ed1b17230d12',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.505019] env[67094]: INFO networking_nsxv3.common.synchronization [req-ee901147-3fe7-43cc-ab03-00cb7f4ee0dc req-9f33e9aa-d5b4-45da-a91a-3911c597b0f3 tempest-ImagesOneServerNegativeTestJSON-1967011174 tempest-ImagesOneServerNegativeTestJSON-1967011174-project-member] Enqueued Resource ID: 71aa8195-5281-4a1c-b9a7-3d40e851f47e with Priority: HIGHEST for action security_group_members [ 972.505019] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 71aa8195-5281-4a1c-b9a7-3d40e851f47e with Priority: HIGHEST for action security_group_members [ 972.505019] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-71aa8195-5281-4a1c-b9a7-3d40e851f47e taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.505019] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.505019] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.506369] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.506550] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.506662] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.506725] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.506896] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.506980] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.507092] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('71aa8195-5281-4a1c-b9a7-3d40e851f47e',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 972.536554] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.536827] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.536827] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.537509] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.537509] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.537509] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d6b6e19-f017-4eac-b0ac-ed1b17230d12 is going to be created. [ 972.562667] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 972.563132] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 972.565017] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 972.565017] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 972.565017] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 972.574747] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d6b6e19-f017-4eac-b0ac-ed1b17230d12 in Status: UNINITIALIZED for 2s [ 973.010600] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.010600] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.010600] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.010600] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.011315] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.011315] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.011315] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.011315] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.011315] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.011631] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.011631] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71aa8195-5281-4a1c-b9a7-3d40e851f47e is going to be updated. [ 973.068830] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 973.068830] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 973.068830] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 973.069109] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 973.070063] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 973.092090] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71aa8195-5281-4a1c-b9a7-3d40e851f47e in Status: IN_PROGRESS for 2s [ 974.063930] env[67094]: INFO networking_nsxv3.common.synchronization [None req-c0908deb-1f29-47ff-a6cb-25d819a4366f None None] Enqueued Resource ID: 44dea840-444f-4779-9344-3b8a795b87a5 with Priority: HIGHEST for action port [ 974.064525] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 44dea840-444f-4779-9344-3b8a795b87a5 with Priority: HIGHEST for action port [ 974.064838] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-44dea840-444f-4779-9344-3b8a795b87a5 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.064984] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-44dea840-444f-4779-9344-3b8a795b87a5" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.065251] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-44dea840-444f-4779-9344-3b8a795b87a5" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.065555] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-44dea840-444f-4779-9344-3b8a795b87a5" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.065653] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('44dea840-444f-4779-9344-3b8a795b87a5',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.399210] env[67094]: INFO networking_nsxv3.common.synchronization [req-c1fc38f9-4872-4b7a-8155-4324f77ae60f req-42557e28-e330-48db-8959-1af1bc55fe85 tempest-ServersAdminTestJSON-236082081 tempest-ServersAdminTestJSON-236082081-project-member] Enqueued Resource ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f with Priority: HIGHEST for action security_group_members [ 974.399852] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f with Priority: HIGHEST for action security_group_members [ 974.400415] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f2ac94a-4beb-4e79-8490-47989224cf9f taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.400606] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.400723] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.401032] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.401294] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.401630] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.401630] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.401775] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.401916] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.402074] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f2ac94a-4beb-4e79-8490-47989224cf9f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.568549] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 44dea840-444f-4779-9344-3b8a795b87a5 [ 974.568777] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.568914] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.568983] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.569226] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.569391] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.569495] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:44dea840-444f-4779-9344-3b8a795b87a5 already deleted. [ 974.569583] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-44dea840-444f-4779-9344-3b8a795b87a5" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.586329] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d6b6e19-f017-4eac-b0ac-ed1b17230d12 in Status: SUCCESS [ 974.586558] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d6b6e19-f017-4eac-b0ac-ed1b17230d12" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.586804] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d6b6e19-f017-4eac-b0ac-ed1b17230d12" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.586923] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d6b6e19-f017-4eac-b0ac-ed1b17230d12" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.587130] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 974.587280] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 974.587370] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 974.587534] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 974.587623] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.587711] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d6b6e19-f017-4eac-b0ac-ed1b17230d12" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 974.587804] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5d6b6e19-f017-4eac-b0ac-ed1b17230d12',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 974.905641] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0f2ac94a-4beb-4e79-8490-47989224cf9f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.090389] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5d6b6e19-f017-4eac-b0ac-ed1b17230d12',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.106578] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 71aa8195-5281-4a1c-b9a7-3d40e851f47e in Status: SUCCESS [ 975.106846] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 71aa8195-5281-4a1c-b9a7-3d40e851f47e deletion is rescheduled due to dependency. [ 975.106974] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-71aa8195-5281-4a1c-b9a7-3d40e851f47e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.409630] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0f2ac94a-4beb-4e79-8490-47989224cf9f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 975.592907] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5d6b6e19-f017-4eac-b0ac-ed1b17230d12: rpc.has_security_group_logging(os_id): False [ 975.611763] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.611999] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.612095] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.612451] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.612451] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.612626] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.612704] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.612795] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.612948] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.613058] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.613267] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5d6b6e19-f017-4eac-b0ac-ed1b17230d12 is going to be created. [ 975.699936] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.700170] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.700296] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.700557] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.700772] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.711486] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d6b6e19-f017-4eac-b0ac-ed1b17230d12 in Status: IN_PROGRESS for 2s [ 975.915168] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.915168] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.915168] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.915168] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.915168] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.915168] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f is going to be updated. [ 975.944266] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 975.944266] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 975.944266] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 975.944266] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 975.944266] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 975.954200] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f in Status: IN_PROGRESS for 2s [ 977.051751] env[67094]: INFO networking_nsxv3.common.synchronization [req-f1d16920-95d4-4bc9-b3e5-67a689ac20f2 req-e6522cd7-f49b-41cd-9bce-5d9e8be07d58 tempest-AttachInterfacesTestJSON-1117082489 tempest-AttachInterfacesTestJSON-1117082489-project-member] Enqueued Resource ID: 882c69d3-9554-45c6-97a1-55fb0f065040 with Priority: HIGHEST for action security_group_members [ 977.052300] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 882c69d3-9554-45c6-97a1-55fb0f065040 with Priority: HIGHEST for action security_group_members [ 977.052623] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-882c69d3-9554-45c6-97a1-55fb0f065040 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.052748] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.052814] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.053126] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.053372] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.053453] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.053453] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.053626] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.053702] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.053791] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('882c69d3-9554-45c6-97a1-55fb0f065040',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.529423] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock network-766 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.529768] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "network-766" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.530849] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "network-766" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.530849] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "network-766" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.531850] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.531850] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.531850] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.532096] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.532154] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.532361] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 977.532467] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 977.532569] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 977.532704] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 977.532928] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 977.533108] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 977.533297] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 977.555782] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.555782] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.555782] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.556237] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.559881] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 977.560201] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 977.560484] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 977.560722] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "network-766" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.562158] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock port-116ba6a1-c634-4693-9978-1ce1b1d73ca3 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.562390] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "port-116ba6a1-c634-4693-9978-1ce1b1d73ca3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.562615] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "port-116ba6a1-c634-4693-9978-1ce1b1d73ca3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.562971] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "port-116ba6a1-c634-4693-9978-1ce1b1d73ca3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.563172] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('116ba6a1-c634-4693-9978-1ce1b1d73ca3',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.588380] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.588380] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.588380] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.588380] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.588380] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.588380] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.588380] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 882c69d3-9554-45c6-97a1-55fb0f065040 is going to be updated. [ 977.621999] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.622897] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.622897] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.623163] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.624463] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.637760] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882c69d3-9554-45c6-97a1-55fb0f065040 in Status: IN_PROGRESS for 2s [ 977.726542] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d6b6e19-f017-4eac-b0ac-ed1b17230d12 in Status: SUCCESS [ 977.726807] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5d6b6e19-f017-4eac-b0ac-ed1b17230d12" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.917459] env[67094]: INFO networking_nsxv3.common.synchronization [req-748fc1f1-33e0-4dd8-9637-b596422bfdac req-2627f2e8-64ab-4ef9-9f69-54a50e5ff2a1 tempest-ServersNegativeTestMultiTenantJSON-1217348700 tempest-ServersNegativeTestMultiTenantJSON-1217348700-project-member] Enqueued Resource ID: a9f3a2fb-a15a-4ea6-a2e4-0a89b6b14559 with Priority: HIGHEST for action security_group_members [ 977.918171] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9f3a2fb-a15a-4ea6-a2e4-0a89b6b14559 with Priority: HIGHEST for action security_group_members [ 977.918510] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-a9f3a2fb-a15a-4ea6-a2e4-0a89b6b14559 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.918663] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-a9f3a2fb-a15a-4ea6-a2e4-0a89b6b14559" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.918699] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-a9f3a2fb-a15a-4ea6-a2e4-0a89b6b14559" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.918976] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-a9f3a2fb-a15a-4ea6-a2e4-0a89b6b14559" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.919226] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 977.919434] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 977.919517] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 977.919743] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 977.919876] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 977.920037] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('a9f3a2fb-a15a-4ea6-a2e4-0a89b6b14559',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 977.964742] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f in Status: SUCCESS [ 977.964985] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.068412] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.068412] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.068412] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.068412] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.068412] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.068412] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Segment Port 116ba6a1-c634-4693-9978-1ce1b1d73ca3 not found, creating... [ 978.068412] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.068412] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.068985] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.068985] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.068985] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.069699] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.069699] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.069910] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.070072] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.070220] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.070400] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Resource: SegmentPort with ID: 116ba6a1-c634-4693-9978-1ce1b1d73ca3 is going to be created. [ 978.094507] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.094802] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.095046] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.095365] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.095640] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.095988] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "port-116ba6a1-c634-4693-9978-1ce1b1d73ca3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.423118] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.423344] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.423393] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.423763] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.424282] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.424560] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.424716] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.424796] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.425088] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.425134] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.425247] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9f3a2fb-a15a-4ea6-a2e4-0a89b6b14559 is going to be updated. [ 978.453152] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.453360] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.453410] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.453631] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.453801] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 978.464130] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9f3a2fb-a15a-4ea6-a2e4-0a89b6b14559 in Status: IN_PROGRESS for 2s [ 978.837643] env[67094]: INFO networking_nsxv3.common.synchronization [req-f1d16920-95d4-4bc9-b3e5-67a689ac20f2 req-c2bbd27f-3319-4c8e-b4ec-e6a6c5e3fbb3 service nova] Enqueued Resource ID: 882c69d3-9554-45c6-97a1-55fb0f065040 with Priority: HIGHEST for action security_group_rules [ 978.837832] env[67094]: INFO networking_nsxv3.common.synchronization [req-f1d16920-95d4-4bc9-b3e5-67a689ac20f2 req-c2bbd27f-3319-4c8e-b4ec-e6a6c5e3fbb3 service nova] Enqueued Resource ID: 882c69d3-9554-45c6-97a1-55fb0f065040 with Priority: HIGHEST for action security_group_members [ 978.837969] env[67094]: INFO networking_nsxv3.common.synchronization [req-f1d16920-95d4-4bc9-b3e5-67a689ac20f2 req-c2bbd27f-3319-4c8e-b4ec-e6a6c5e3fbb3 service nova] Enqueued Resource ID: 116ba6a1-c634-4693-9978-1ce1b1d73ca3 with Priority: HIGHEST for action port [ 978.838560] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 882c69d3-9554-45c6-97a1-55fb0f065040 with Priority: HIGHEST for action security_group_rules [ 978.838712] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 882c69d3-9554-45c6-97a1-55fb0f065040 with Priority: HIGHEST for action security_group_members [ 978.838810] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 116ba6a1-c634-4693-9978-1ce1b1d73ca3 with Priority: HIGHEST for action port [ 978.839112] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-882c69d3-9554-45c6-97a1-55fb0f065040 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.839237] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.839355] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.839585] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.839667] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('882c69d3-9554-45c6-97a1-55fb0f065040',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 978.840590] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-882c69d3-9554-45c6-97a1-55fb0f065040 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.840691] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.840889] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-116ba6a1-c634-4693-9978-1ce1b1d73ca3 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 978.840988] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-116ba6a1-c634-4693-9978-1ce1b1d73ca3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 978.841065] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-116ba6a1-c634-4693-9978-1ce1b1d73ca3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 978.841244] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-116ba6a1-c634-4693-9978-1ce1b1d73ca3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 978.841320] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('116ba6a1-c634-4693-9978-1ce1b1d73ca3',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 979.343648] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-882c69d3-9554-45c6-97a1-55fb0f065040 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.343979] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.345225] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 116ba6a1-c634-4693-9978-1ce1b1d73ca3 with status ACTIVE [ 979.345472] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.345624] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.345710] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.345987] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.346117] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.346365] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.346507] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.346596] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.346799] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.346917] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.347219] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.347377] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.347467] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.347671] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.347789] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.347918] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 116ba6a1-c634-4693-9978-1ce1b1d73ca3 is going to be updated. [ 979.371197] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.371394] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.371440] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.371717] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.371894] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.372126] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-116ba6a1-c634-4693-9978-1ce1b1d73ca3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.647562] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882c69d3-9554-45c6-97a1-55fb0f065040 in Status: SUCCESS [ 979.647765] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 882c69d3-9554-45c6-97a1-55fb0f065040 deletion is rescheduled due to dependency. [ 979.647879] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.648104] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.648292] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.648945] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 979.648945] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 979.648945] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 979.648945] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 979.648945] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 979.649371] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('882c69d3-9554-45c6-97a1-55fb0f065040',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.151528] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('882c69d3-9554-45c6-97a1-55fb0f065040',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 980.474511] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: a9f3a2fb-a15a-4ea6-a2e4-0a89b6b14559 in Status: SUCCESS [ 980.474911] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: a9f3a2fb-a15a-4ea6-a2e4-0a89b6b14559 deletion is rescheduled due to dependency. [ 980.474911] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-a9f3a2fb-a15a-4ea6-a2e4-0a89b6b14559" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 980.655941] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('882c69d3-9554-45c6-97a1-55fb0f065040',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 981.158436] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.158618] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.158618] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.158874] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.158966] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.159043] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 882c69d3-9554-45c6-97a1-55fb0f065040 is going to be updated. [ 981.195075] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 981.195296] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 981.195296] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 981.195570] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 981.195733] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 981.205023] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882c69d3-9554-45c6-97a1-55fb0f065040 in Status: IN_PROGRESS for 2s [ 982.606586] env[67094]: INFO networking_nsxv3.common.synchronization [req-7390a250-06fc-43da-a5b7-d63c91cae3a2 req-c1bbd9e9-25f9-4f2d-833c-386b2c933afe tempest-ServersTestJSON-1070791530 tempest-ServersTestJSON-1070791530-project-member] Enqueued Resource ID: c0881101-1be1-4dbf-ac18-2d54a689202c with Priority: HIGHEST for action security_group_members [ 982.607221] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0881101-1be1-4dbf-ac18-2d54a689202c with Priority: HIGHEST for action security_group_members [ 982.609142] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0881101-1be1-4dbf-ac18-2d54a689202c taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.609142] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.609142] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.609142] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.609142] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 982.609142] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 982.609142] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 982.609142] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 982.609142] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 982.609142] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.115292] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.219486] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882c69d3-9554-45c6-97a1-55fb0f065040 in Status: SUCCESS [ 983.219764] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.220051] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.220465] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.220598] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.220737] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.220853] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.221053] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.221182] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.221369] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.221459] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('882c69d3-9554-45c6-97a1-55fb0f065040',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.260056] env[67094]: INFO networking_nsxv3.common.synchronization [req-abb0f594-3b02-459c-938a-2bcb4478e13d req-da0202c0-4b07-47f7-9fa9-594aa998b646 tempest-ServerActionsTestOtherA-276518123 tempest-ServerActionsTestOtherA-276518123-project-member] Enqueued Resource ID: 6745d4e2-6069-4132-80d9-76cf2245b017 with Priority: HIGHEST for action security_group_members [ 983.260540] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6745d4e2-6069-4132-80d9-76cf2245b017 with Priority: HIGHEST for action security_group_members [ 983.260907] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-6745d4e2-6069-4132-80d9-76cf2245b017 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.261073] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6745d4e2-6069-4132-80d9-76cf2245b017" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.261170] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6745d4e2-6069-4132-80d9-76cf2245b017" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.261413] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6745d4e2-6069-4132-80d9-76cf2245b017" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.261972] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.261972] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.261972] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.261972] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.262187] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.262187] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6745d4e2-6069-4132-80d9-76cf2245b017',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.617249] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.725122] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-882c69d3-9554-45c6-97a1-55fb0f065040 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.725122] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.725122] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.725122] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.725122] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.725122] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.725122] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.725635] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.725917] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.726018] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.726249] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-882c69d3-9554-45c6-97a1-55fb0f065040 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.726351] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.726351] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.726563] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.726739] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.726822] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.726888] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.727337] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.727337] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.727337] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.727337] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('882c69d3-9554-45c6-97a1-55fb0f065040',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 983.765205] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.765351] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.765733] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.765953] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.766054] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.766257] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.766355] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.766419] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.766571] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.766646] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.766740] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6745d4e2-6069-4132-80d9-76cf2245b017 is going to be updated. [ 983.797706] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 983.797874] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 983.797948] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 983.798269] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 983.798358] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 983.809150] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6745d4e2-6069-4132-80d9-76cf2245b017 in Status: IN_PROGRESS for 2s [ 984.120721] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.120955] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.121054] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.121269] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.121353] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.121465] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0881101-1be1-4dbf-ac18-2d54a689202c is going to be updated. [ 984.154212] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.154627] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.154627] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.154754] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.154853] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.164831] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0881101-1be1-4dbf-ac18-2d54a689202c in Status: IN_PROGRESS for 2s [ 984.229870] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 882c69d3-9554-45c6-97a1-55fb0f065040: rpc.has_security_group_logging(os_id): False [ 984.253281] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.253502] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.253502] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.253739] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.253879] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.254245] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.254416] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.254565] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.254668] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.254750] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.254955] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.255918] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.257092] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.257092] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.257181] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.257370] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.257470] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.257534] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.257685] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.257764] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.257850] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 882c69d3-9554-45c6-97a1-55fb0f065040 is going to be updated. [ 984.362338] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.362515] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.362638] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.362871] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.362991] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.379952] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 882c69d3-9554-45c6-97a1-55fb0f065040 in Status: IN_PROGRESS for 2s [ 984.557184] env[67094]: INFO networking_nsxv3.common.synchronization [None req-4efad059-b5ce-4a3b-86f7-bbc33ae5cf28 tempest-AttachInterfacesTestJSON-1117082489 tempest-AttachInterfacesTestJSON-1117082489-project-member] Enqueued Resource ID: 882c69d3-9554-45c6-97a1-55fb0f065040 with Priority: HIGHEST for action security_group_members [ 984.557184] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 882c69d3-9554-45c6-97a1-55fb0f065040 with Priority: HIGHEST for action security_group_members [ 984.557184] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-882c69d3-9554-45c6-97a1-55fb0f065040 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.557184] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.557184] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.557184] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.557184] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 984.560813] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 984.560813] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 984.560813] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 984.560813] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 984.560813] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('882c69d3-9554-45c6-97a1-55fb0f065040',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.063027] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('882c69d3-9554-45c6-97a1-55fb0f065040',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.239431] env[67094]: INFO networking_nsxv3.common.synchronization [None req-2d6ef2ae-4efb-4fc1-9530-a4f44ef84bdb None None] Enqueued Resource ID: 8a5fbf8b-ad06-4a62-b2e9-cbe6bf57c42b with Priority: HIGHEST for action port [ 985.240343] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8a5fbf8b-ad06-4a62-b2e9-cbe6bf57c42b with Priority: HIGHEST for action port [ 985.242417] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-8a5fbf8b-ad06-4a62-b2e9-cbe6bf57c42b taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.242562] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8a5fbf8b-ad06-4a62-b2e9-cbe6bf57c42b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.242617] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8a5fbf8b-ad06-4a62-b2e9-cbe6bf57c42b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.244943] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8a5fbf8b-ad06-4a62-b2e9-cbe6bf57c42b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.244943] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8a5fbf8b-ad06-4a62-b2e9-cbe6bf57c42b',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.566586] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('882c69d3-9554-45c6-97a1-55fb0f065040',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 985.747669] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 8a5fbf8b-ad06-4a62-b2e9-cbe6bf57c42b [ 985.747958] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 985.748126] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 985.748230] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 985.748489] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 985.748623] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.748786] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:8a5fbf8b-ad06-4a62-b2e9-cbe6bf57c42b already deleted. [ 985.748898] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8a5fbf8b-ad06-4a62-b2e9-cbe6bf57c42b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 985.820354] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6745d4e2-6069-4132-80d9-76cf2245b017 in Status: SUCCESS [ 985.820596] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6745d4e2-6069-4132-80d9-76cf2245b017 deletion is rescheduled due to dependency. [ 985.820743] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6745d4e2-6069-4132-80d9-76cf2245b017" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.069793] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.070178] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.070178] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.070278] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.070695] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.070695] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 882c69d3-9554-45c6-97a1-55fb0f065040 is going to be updated. [ 986.105826] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 986.105993] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 986.105993] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 986.106316] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 986.106501] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.119795] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882c69d3-9554-45c6-97a1-55fb0f065040 in Status: IN_PROGRESS for 2s [ 986.176022] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0881101-1be1-4dbf-ac18-2d54a689202c in Status: SUCCESS [ 986.176254] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 986.398277] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 882c69d3-9554-45c6-97a1-55fb0f065040 in Status: SUCCESS [ 986.398595] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.133717] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882c69d3-9554-45c6-97a1-55fb0f065040 in Status: SUCCESS [ 988.134049] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.368680] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock network-766 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.368680] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "network-766" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.368896] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "network-766" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.369091] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "network-766" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.369824] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.369824] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.369824] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.370051] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.370051] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.370240] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 988.370354] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 988.370496] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 988.370610] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 988.370737] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 988.370845] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 988.370995] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 988.395354] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 988.395354] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 988.395354] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 988.395354] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "network-766" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.395354] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock port-75877aed-8091-46e3-a118-111379d7caf7 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.395354] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "port-75877aed-8091-46e3-a118-111379d7caf7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.395354] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "port-75877aed-8091-46e3-a118-111379d7caf7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.395354] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "port-75877aed-8091-46e3-a118-111379d7caf7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.395354] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75877aed-8091-46e3-a118-111379d7caf7',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.631693] env[67094]: INFO networking_nsxv3.common.synchronization [req-aa8ef977-46dc-412d-ba04-71f448463acf req-e9b39f60-1619-4d74-9614-3af3094c4ac9 tempest-ServerRescueTestJSON-685643514 tempest-ServerRescueTestJSON-685643514-project-member] Enqueued Resource ID: 3ece2d85-d26d-4c59-ae47-b9a59cc4de8f with Priority: HIGHEST for action security_group_members [ 988.634018] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ece2d85-d26d-4c59-ae47-b9a59cc4de8f with Priority: HIGHEST for action security_group_members [ 988.634018] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ece2d85-d26d-4c59-ae47-b9a59cc4de8f taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.634018] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ece2d85-d26d-4c59-ae47-b9a59cc4de8f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.634018] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ece2d85-d26d-4c59-ae47-b9a59cc4de8f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.634018] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ece2d85-d26d-4c59-ae47-b9a59cc4de8f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.634018] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.634018] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.634018] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.634018] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.634018] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.634018] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ece2d85-d26d-4c59-ae47-b9a59cc4de8f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.738299] env[67094]: INFO networking_nsxv3.common.synchronization [None req-d050eb4c-0537-438e-b81d-276de593b936 None None] Enqueued Resource ID: 2098ce46-eb4e-40ae-882a-b16efd259cc3 with Priority: HIGHEST for action port [ 988.739058] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2098ce46-eb4e-40ae-882a-b16efd259cc3 with Priority: HIGHEST for action port [ 988.739200] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-2098ce46-eb4e-40ae-882a-b16efd259cc3 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.740070] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-2098ce46-eb4e-40ae-882a-b16efd259cc3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.740070] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-2098ce46-eb4e-40ae-882a-b16efd259cc3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.740070] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-2098ce46-eb4e-40ae-882a-b16efd259cc3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.740070] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('2098ce46-eb4e-40ae-882a-b16efd259cc3',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 988.896311] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.896555] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.896730] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.897757] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.897757] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.897757] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Segment Port 75877aed-8091-46e3-a118-111379d7caf7 not found, creating... [ 988.898013] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.898277] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.898396] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.898672] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.899406] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.899406] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.899406] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.901771] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.901771] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.901771] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.901771] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Resource: SegmentPort with ID: 75877aed-8091-46e3-a118-111379d7caf7 is going to be created. [ 988.922635] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 988.922855] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 988.922978] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 988.923289] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 988.923554] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 988.925841] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "port-75877aed-8091-46e3-a118-111379d7caf7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.136475] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3ece2d85-d26d-4c59-ae47-b9a59cc4de8f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.241945] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 2098ce46-eb4e-40ae-882a-b16efd259cc3 [ 989.242211] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.242594] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.242714] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.242947] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.243050] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.243152] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:2098ce46-eb4e-40ae-882a-b16efd259cc3 already deleted. [ 989.243245] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-2098ce46-eb4e-40ae-882a-b16efd259cc3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.640164] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3ece2d85-d26d-4c59-ae47-b9a59cc4de8f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.903872] env[67094]: INFO networking_nsxv3.common.synchronization [req-0b3974e0-9bf5-4d45-939b-f0a113b4a63a req-191239b0-c071-430f-8dc7-a970d3fe7070 service nova] Enqueued Resource ID: 882c69d3-9554-45c6-97a1-55fb0f065040 with Priority: HIGHEST for action security_group_rules [ 989.903872] env[67094]: INFO networking_nsxv3.common.synchronization [req-0b3974e0-9bf5-4d45-939b-f0a113b4a63a req-191239b0-c071-430f-8dc7-a970d3fe7070 service nova] Enqueued Resource ID: 882c69d3-9554-45c6-97a1-55fb0f065040 with Priority: HIGHEST for action security_group_members [ 989.903872] env[67094]: INFO networking_nsxv3.common.synchronization [req-0b3974e0-9bf5-4d45-939b-f0a113b4a63a req-191239b0-c071-430f-8dc7-a970d3fe7070 service nova] Enqueued Resource ID: 75877aed-8091-46e3-a118-111379d7caf7 with Priority: HIGHEST for action port [ 989.903872] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 882c69d3-9554-45c6-97a1-55fb0f065040 with Priority: HIGHEST for action security_group_rules [ 989.903872] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 882c69d3-9554-45c6-97a1-55fb0f065040 with Priority: HIGHEST for action security_group_members [ 989.903872] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 75877aed-8091-46e3-a118-111379d7caf7 with Priority: HIGHEST for action port [ 989.904400] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-882c69d3-9554-45c6-97a1-55fb0f065040 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.904643] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.904798] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.905102] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.905283] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('882c69d3-9554-45c6-97a1-55fb0f065040',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.907515] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-882c69d3-9554-45c6-97a1-55fb0f065040 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.907593] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.907666] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.908971] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.908971] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.908971] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.908971] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.908971] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.908971] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 989.908971] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('882c69d3-9554-45c6-97a1-55fb0f065040',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 989.909371] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-75877aed-8091-46e3-a118-111379d7caf7 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 989.909371] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-75877aed-8091-46e3-a118-111379d7caf7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 989.909495] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-75877aed-8091-46e3-a118-111379d7caf7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 989.909553] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-75877aed-8091-46e3-a118-111379d7caf7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 989.909626] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('75877aed-8091-46e3-a118-111379d7caf7',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.143143] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.143493] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.143493] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.144665] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.144665] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.144665] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ece2d85-d26d-4c59-ae47-b9a59cc4de8f is going to be updated. [ 990.176754] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.176903] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.176970] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.177216] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.177366] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.187048] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ece2d85-d26d-4c59-ae47-b9a59cc4de8f in Status: IN_PROGRESS for 2s [ 990.214967] env[67094]: INFO networking_nsxv3.common.synchronization [req-54b8dc30-f102-4244-bc21-6d37891cbea0 req-57a98332-edf8-49ef-b5a7-ca90858da896 tempest-InstanceActionsV221TestJSON-231057085 tempest-InstanceActionsV221TestJSON-231057085-project-member] Enqueued Resource ID: fa13d7cb-fe19-4ac5-ab31-738acdf72313 with Priority: HIGHEST for action security_group_members [ 990.215579] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa13d7cb-fe19-4ac5-ab31-738acdf72313 with Priority: HIGHEST for action security_group_members [ 990.216938] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa13d7cb-fe19-4ac5-ab31-738acdf72313 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.216938] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa13d7cb-fe19-4ac5-ab31-738acdf72313" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.216938] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa13d7cb-fe19-4ac5-ab31-738acdf72313" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.216938] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa13d7cb-fe19-4ac5-ab31-738acdf72313" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.216938] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.216938] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.216938] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.217348] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.217473] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.217582] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fa13d7cb-fe19-4ac5-ab31-738acdf72313',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.412852] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-882c69d3-9554-45c6-97a1-55fb0f065040 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.412852] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.412852] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 75877aed-8091-46e3-a118-111379d7caf7 with status ACTIVE [ 990.413210] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.413210] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.413294] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.413519] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.413753] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.413878] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.414761] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.414761] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.414761] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.414761] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.414761] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.414761] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.414761] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.414761] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.416055] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.416055] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 75877aed-8091-46e3-a118-111379d7caf7 is going to be updated. [ 990.416267] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('882c69d3-9554-45c6-97a1-55fb0f065040',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.440421] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.440626] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.440672] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.440857] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.440989] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.441163] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-75877aed-8091-46e3-a118-111379d7caf7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.721828] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.721828] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.721828] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.721828] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.721828] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.721828] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.721828] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.721828] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.722314] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.722314] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.722314] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa13d7cb-fe19-4ac5-ab31-738acdf72313 already deleted. [ 990.722401] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa13d7cb-fe19-4ac5-ab31-738acdf72313" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.763325] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock network-94 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.763538] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "network-94" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.763664] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "network-94" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.764085] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "network-94" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.764389] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.764554] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.764671] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.764953] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.765121] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.765367] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 990.765495] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 990.765604] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 990.765707] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 990.765814] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 990.765915] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 990.766167] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 990.787243] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 990.787652] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 990.787860] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 990.788669] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "network-94" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 990.788669] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock port-759a9137-7057-4d57-bce2-74679c00e182 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 990.788669] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "port-759a9137-7057-4d57-bce2-74679c00e182" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 990.792178] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "port-759a9137-7057-4d57-bce2-74679c00e182" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 990.792399] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "port-759a9137-7057-4d57-bce2-74679c00e182" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 990.792587] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('759a9137-7057-4d57-bce2-74679c00e182',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 990.918328] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('882c69d3-9554-45c6-97a1-55fb0f065040',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 991.295246] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.295661] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.295715] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.295985] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.296171] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.296332] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Segment Port 759a9137-7057-4d57-bce2-74679c00e182 not found, creating... [ 991.296618] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.296984] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.296984] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.297187] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.297388] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.297741] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.297911] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.298044] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.298284] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.298421] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.298563] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Resource: SegmentPort with ID: 759a9137-7057-4d57-bce2-74679c00e182 is going to be created. [ 991.320918] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.321162] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.321293] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.321580] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.321820] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.322057] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "port-759a9137-7057-4d57-bce2-74679c00e182" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.421048] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.421048] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.421233] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.421494] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.421653] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.421808] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 882c69d3-9554-45c6-97a1-55fb0f065040 is going to be updated. [ 991.459780] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.460085] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.460221] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.460463] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.460607] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 991.473680] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882c69d3-9554-45c6-97a1-55fb0f065040 in Status: IN_PROGRESS for 2s [ 991.527525] env[67094]: INFO networking_nsxv3.common.synchronization [None req-68f529de-6045-4cb3-853e-3b4f7c041f30 None None] Enqueued Resource ID: 26860986-88dd-4997-826c-b5add5d0ef28 with Priority: HIGHEST for action port [ 991.528290] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 26860986-88dd-4997-826c-b5add5d0ef28 with Priority: HIGHEST for action port [ 991.528707] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-26860986-88dd-4997-826c-b5add5d0ef28 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 991.529076] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-26860986-88dd-4997-826c-b5add5d0ef28" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 991.529076] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-26860986-88dd-4997-826c-b5add5d0ef28" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 991.529427] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-26860986-88dd-4997-826c-b5add5d0ef28" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 991.529531] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('26860986-88dd-4997-826c-b5add5d0ef28',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.016436] env[67094]: INFO networking_nsxv3.common.synchronization [req-54b8dc30-f102-4244-bc21-6d37891cbea0 req-433d14d2-6876-4d7d-b523-3ed8430fb4d9 service nova] Enqueued Resource ID: fa13d7cb-fe19-4ac5-ab31-738acdf72313 with Priority: HIGHEST for action security_group_rules [ 992.016617] env[67094]: INFO networking_nsxv3.common.synchronization [req-54b8dc30-f102-4244-bc21-6d37891cbea0 req-433d14d2-6876-4d7d-b523-3ed8430fb4d9 service nova] Enqueued Resource ID: fa13d7cb-fe19-4ac5-ab31-738acdf72313 with Priority: HIGHEST for action security_group_members [ 992.016796] env[67094]: INFO networking_nsxv3.common.synchronization [req-54b8dc30-f102-4244-bc21-6d37891cbea0 req-433d14d2-6876-4d7d-b523-3ed8430fb4d9 service nova] Enqueued Resource ID: 759a9137-7057-4d57-bce2-74679c00e182 with Priority: HIGHEST for action port [ 992.017400] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa13d7cb-fe19-4ac5-ab31-738acdf72313 with Priority: HIGHEST for action security_group_rules [ 992.017570] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa13d7cb-fe19-4ac5-ab31-738acdf72313 with Priority: HIGHEST for action security_group_members [ 992.017671] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 759a9137-7057-4d57-bce2-74679c00e182 with Priority: HIGHEST for action port [ 992.018170] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fa13d7cb-fe19-4ac5-ab31-738acdf72313 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.019133] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fa13d7cb-fe19-4ac5-ab31-738acdf72313" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.021253] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fa13d7cb-fe19-4ac5-ab31-738acdf72313" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.021559] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fa13d7cb-fe19-4ac5-ab31-738acdf72313" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.021682] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fa13d7cb-fe19-4ac5-ab31-738acdf72313',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.023247] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa13d7cb-fe19-4ac5-ab31-738acdf72313 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.023403] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa13d7cb-fe19-4ac5-ab31-738acdf72313" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.023584] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa13d7cb-fe19-4ac5-ab31-738acdf72313" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.023663] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa13d7cb-fe19-4ac5-ab31-738acdf72313" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.023830] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.023941] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.024015] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.024169] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.024251] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.024344] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fa13d7cb-fe19-4ac5-ab31-738acdf72313',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.025339] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-759a9137-7057-4d57-bce2-74679c00e182 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.025339] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-759a9137-7057-4d57-bce2-74679c00e182" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.025453] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-759a9137-7057-4d57-bce2-74679c00e182" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.026742] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-759a9137-7057-4d57-bce2-74679c00e182" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.026742] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('759a9137-7057-4d57-bce2-74679c00e182',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.032618] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 26860986-88dd-4997-826c-b5add5d0ef28 [ 992.032618] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.033346] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.033346] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.037123] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.037123] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.037123] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:26860986-88dd-4997-826c-b5add5d0ef28 already deleted. [ 992.037123] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-26860986-88dd-4997-826c-b5add5d0ef28" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.199811] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ece2d85-d26d-4c59-ae47-b9a59cc4de8f in Status: SUCCESS [ 992.200090] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ece2d85-d26d-4c59-ae47-b9a59cc4de8f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.528316] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fa13d7cb-fe19-4ac5-ab31-738acdf72313',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 992.529703] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa13d7cb-fe19-4ac5-ab31-738acdf72313 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.530030] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa13d7cb-fe19-4ac5-ab31-738acdf72313" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.530654] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 759a9137-7057-4d57-bce2-74679c00e182 with status ACTIVE [ 992.532022] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.532022] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.532022] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.532022] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.532022] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.532022] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.532022] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.532022] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.532855] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.533036] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.533313] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.533524] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.533684] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.534018] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.535590] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.535590] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 759a9137-7057-4d57-bce2-74679c00e182 is going to be updated. [ 992.560407] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 992.560407] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 992.560407] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 992.560591] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 992.560680] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 992.561610] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-759a9137-7057-4d57-bce2-74679c00e182" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.093828] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fa13d7cb-fe19-4ac5-ab31-738acdf72313',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.486061] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882c69d3-9554-45c6-97a1-55fb0f065040 in Status: SUCCESS [ 993.486314] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.486489] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.486714] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.486992] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.487147] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.487216] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.487332] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.487481] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.487553] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.487636] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('882c69d3-9554-45c6-97a1-55fb0f065040',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 993.596996] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.596996] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.596996] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.596996] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.597791] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.597791] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa13d7cb-fe19-4ac5-ab31-738acdf72313 is going to be created. [ 993.627953] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.627953] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.627953] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.628151] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.628276] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.644607] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa13d7cb-fe19-4ac5-ab31-738acdf72313 in Status: UNINITIALIZED for 2s [ 993.991896] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-882c69d3-9554-45c6-97a1-55fb0f065040 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.992102] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.992176] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.992469] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.993407] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.993407] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.993407] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.993407] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.993407] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.993407] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.993407] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-882c69d3-9554-45c6-97a1-55fb0f065040 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.993407] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.993756] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.993756] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.993756] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 993.993862] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 993.993862] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 993.994228] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 993.994228] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.994228] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 993.994228] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('882c69d3-9554-45c6-97a1-55fb0f065040',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.221887] env[67094]: INFO networking_nsxv3.common.synchronization [None req-907f2260-d110-44fd-80c2-a3d51239c954 None None] Enqueued Resource ID: 578b6ce8-38a7-4e93-a42d-674edba1abec with Priority: HIGHEST for action port [ 994.223987] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 578b6ce8-38a7-4e93-a42d-674edba1abec with Priority: HIGHEST for action port [ 994.223987] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-578b6ce8-38a7-4e93-a42d-674edba1abec taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.223987] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-578b6ce8-38a7-4e93-a42d-674edba1abec" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.223987] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-578b6ce8-38a7-4e93-a42d-674edba1abec" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.224246] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-578b6ce8-38a7-4e93-a42d-674edba1abec" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.224412] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('578b6ce8-38a7-4e93-a42d-674edba1abec',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 994.496367] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 882c69d3-9554-45c6-97a1-55fb0f065040: rpc.has_security_group_logging(os_id): False [ 994.518386] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.518386] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.518386] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.518386] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.518386] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.518386] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.518386] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.518386] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.518386] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.518386] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.518867] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.518867] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.518867] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.518867] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.518989] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.521023] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.521023] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.521023] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.521023] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.521023] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.521023] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 882c69d3-9554-45c6-97a1-55fb0f065040 is going to be updated. [ 994.592608] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.593617] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.593617] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.593617] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.593785] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.608942] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 882c69d3-9554-45c6-97a1-55fb0f065040 in Status: IN_PROGRESS for 2s [ 994.729663] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 578b6ce8-38a7-4e93-a42d-674edba1abec [ 994.731296] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 994.731296] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 994.731296] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 994.731296] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 994.731296] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 994.731296] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:578b6ce8-38a7-4e93-a42d-674edba1abec already deleted. [ 994.731296] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-578b6ce8-38a7-4e93-a42d-674edba1abec" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.657815] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa13d7cb-fe19-4ac5-ab31-738acdf72313 in Status: SUCCESS [ 995.658703] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa13d7cb-fe19-4ac5-ab31-738acdf72313" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.659059] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa13d7cb-fe19-4ac5-ab31-738acdf72313" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.659324] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa13d7cb-fe19-4ac5-ab31-738acdf72313" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.659700] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 995.660158] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 995.660158] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 995.660612] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 995.660612] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.660612] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa13d7cb-fe19-4ac5-ab31-738acdf72313" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 995.660785] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fa13d7cb-fe19-4ac5-ab31-738acdf72313',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.164186] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa13d7cb-fe19-4ac5-ab31-738acdf72313 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.164319] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa13d7cb-fe19-4ac5-ab31-738acdf72313" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.164357] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa13d7cb-fe19-4ac5-ab31-738acdf72313" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.164593] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa13d7cb-fe19-4ac5-ab31-738acdf72313" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.164891] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.164891] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.165030] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.165108] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.165174] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.165254] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa13d7cb-fe19-4ac5-ab31-738acdf72313" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.165399] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa13d7cb-fe19-4ac5-ab31-738acdf72313 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.165490] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa13d7cb-fe19-4ac5-ab31-738acdf72313" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.165548] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa13d7cb-fe19-4ac5-ab31-738acdf72313" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.165688] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa13d7cb-fe19-4ac5-ab31-738acdf72313" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.165826] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.165915] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.165973] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.166192] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.166192] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.166276] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa13d7cb-fe19-4ac5-ab31-738acdf72313" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.166356] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fa13d7cb-fe19-4ac5-ab31-738acdf72313',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 996.627167] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 882c69d3-9554-45c6-97a1-55fb0f065040 in Status: SUCCESS [ 996.627234] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.669164] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fa13d7cb-fe19-4ac5-ab31-738acdf72313: rpc.has_security_group_logging(os_id): False [ 996.691244] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.691386] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.691757] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.691757] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.691757] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.691979] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.692086] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.692150] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.692300] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.692380] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.693395] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.693395] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.693395] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.693395] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.693395] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.693715] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.693862] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.693945] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.694138] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.694220] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.694309] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fa13d7cb-fe19-4ac5-ab31-738acdf72313 is going to be created. [ 996.761302] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 996.761302] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 996.761302] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 996.761603] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 996.761678] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 996.775622] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fa13d7cb-fe19-4ac5-ab31-738acdf72313 in Status: IN_PROGRESS for 2s [ 997.846515] env[67094]: INFO networking_nsxv3.common.synchronization [None req-a46566a1-62b5-4cac-9810-9ca01aae9ea0 tempest-ServerActionsTestOtherA-276518123 tempest-ServerActionsTestOtherA-276518123-project-member] Enqueued Resource ID: 4ec74abc-987a-4435-8c42-e7e606ef3293 with Priority: HIGHEST for action security_group_rules [ 997.847118] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ec74abc-987a-4435-8c42-e7e606ef3293 with Priority: HIGHEST for action security_group_rules [ 997.847439] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4ec74abc-987a-4435-8c42-e7e606ef3293 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 997.847548] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4ec74abc-987a-4435-8c42-e7e606ef3293" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 997.847622] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4ec74abc-987a-4435-8c42-e7e606ef3293" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 997.847873] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4ec74abc-987a-4435-8c42-e7e606ef3293" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 997.847983] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4ec74abc-987a-4435-8c42-e7e606ef3293',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.151942] env[67094]: INFO networking_nsxv3.common.synchronization [None req-910e7eb4-4dc5-4030-aa8b-78b7f516391a tempest-ServerActionsTestOtherA-276518123 tempest-ServerActionsTestOtherA-276518123-project-member] Enqueued Resource ID: 4ec74abc-987a-4435-8c42-e7e606ef3293 with Priority: HIGHEST for action security_group_rules [ 998.153456] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ec74abc-987a-4435-8c42-e7e606ef3293 with Priority: HIGHEST for action security_group_rules [ 998.153787] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4ec74abc-987a-4435-8c42-e7e606ef3293 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.153892] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4ec74abc-987a-4435-8c42-e7e606ef3293" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.373686] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.373686] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.373686] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.374560] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.374560] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.374560] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4ec74abc-987a-4435-8c42-e7e606ef3293 already deleted. [ 998.374560] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4ec74abc-987a-4435-8c42-e7e606ef3293" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.374560] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4ec74abc-987a-4435-8c42-e7e606ef3293" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.374816] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4ec74abc-987a-4435-8c42-e7e606ef3293" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.374816] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4ec74abc-987a-4435-8c42-e7e606ef3293',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.632436] env[67094]: INFO networking_nsxv3.common.synchronization [req-9b678c5c-27ca-4f9a-aa1c-5bddd1e0511d req-648a5355-075d-4b24-be7e-9472d50ad1ce tempest-ServersAdminTestJSON-236082081 tempest-ServersAdminTestJSON-236082081-project-member] Enqueued Resource ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f with Priority: HIGHEST for action security_group_members [ 998.633062] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f with Priority: HIGHEST for action security_group_members [ 998.633173] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f2ac94a-4beb-4e79-8490-47989224cf9f taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.633255] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.633340] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.633513] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.633665] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.633765] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.633842] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.633980] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.634077] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.634170] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f2ac94a-4beb-4e79-8490-47989224cf9f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 998.790615] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fa13d7cb-fe19-4ac5-ab31-738acdf72313 in Status: SUCCESS [ 998.790870] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fa13d7cb-fe19-4ac5-ab31-738acdf72313" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.909513] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 998.909889] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 998.909889] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 998.910077] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 998.910077] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 998.910174] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4ec74abc-987a-4435-8c42-e7e606ef3293 already deleted. [ 998.910290] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4ec74abc-987a-4435-8c42-e7e606ef3293" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.137974] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.138139] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.138209] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.138422] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.161157] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.161157] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.163241] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.163364] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.164521] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.164521] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.164521] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f is going to be updated. [ 999.212142] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.212369] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.212369] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.212601] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.212637] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.224387] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f in Status: IN_PROGRESS for 2s [ 999.317544] env[67094]: INFO networking_nsxv3.common.synchronization [None req-4935aec8-ca13-4e18-aefc-11951bd37acc tempest-ServerDiskConfigTestJSON-51233165 tempest-ServerDiskConfigTestJSON-51233165-project-member] Enqueued Resource ID: 8e6774a3-92bc-4e14-8b29-923d2a84c87d with Priority: HIGHEST for action security_group_rules [ 999.318084] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e6774a3-92bc-4e14-8b29-923d2a84c87d with Priority: HIGHEST for action security_group_rules [ 999.318391] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8e6774a3-92bc-4e14-8b29-923d2a84c87d taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.320689] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8e6774a3-92bc-4e14-8b29-923d2a84c87d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.320689] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8e6774a3-92bc-4e14-8b29-923d2a84c87d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.320689] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8e6774a3-92bc-4e14-8b29-923d2a84c87d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.320846] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8e6774a3-92bc-4e14-8b29-923d2a84c87d',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 999.456473] env[67094]: INFO networking_nsxv3.common.synchronization [None req-a74f6b65-28e6-44ff-9b9a-b82f7065d486 tempest-ServerDiskConfigTestJSON-51233165 tempest-ServerDiskConfigTestJSON-51233165-project-member] Enqueued Resource ID: 8e6774a3-92bc-4e14-8b29-923d2a84c87d with Priority: HIGHEST for action security_group_rules [ 999.457018] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e6774a3-92bc-4e14-8b29-923d2a84c87d with Priority: HIGHEST for action security_group_rules [ 999.457342] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8e6774a3-92bc-4e14-8b29-923d2a84c87d taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.457451] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8e6774a3-92bc-4e14-8b29-923d2a84c87d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.843884] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 999.844057] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 999.844836] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.844836] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.844836] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.844836] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8e6774a3-92bc-4e14-8b29-923d2a84c87d already deleted. [ 999.844836] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8e6774a3-92bc-4e14-8b29-923d2a84c87d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 999.845053] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8e6774a3-92bc-4e14-8b29-923d2a84c87d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 999.845258] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8e6774a3-92bc-4e14-8b29-923d2a84c87d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 999.845357] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8e6774a3-92bc-4e14-8b29-923d2a84c87d',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1000.373452] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.373452] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.373452] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.373452] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.373452] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.373452] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8e6774a3-92bc-4e14-8b29-923d2a84c87d already deleted. [ 1000.373452] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8e6774a3-92bc-4e14-8b29-923d2a84c87d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1000.712822] env[67094]: INFO networking_nsxv3.common.synchronization [None req-64ab9e53-1e11-4cc4-aab7-9c44be11eda6 None None] Enqueued Resource ID: fee7d044-53f7-49bc-987e-d9e28c0c329b with Priority: HIGHEST for action port [ 1000.713481] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fee7d044-53f7-49bc-987e-d9e28c0c329b with Priority: HIGHEST for action port [ 1000.713851] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-fee7d044-53f7-49bc-987e-d9e28c0c329b taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1000.713955] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fee7d044-53f7-49bc-987e-d9e28c0c329b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1000.714028] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fee7d044-53f7-49bc-987e-d9e28c0c329b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1000.714331] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fee7d044-53f7-49bc-987e-d9e28c0c329b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1000.714456] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fee7d044-53f7-49bc-987e-d9e28c0c329b',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1001.220738] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fee7d044-53f7-49bc-987e-d9e28c0c329b [ 1001.221152] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.221284] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.221356] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.221582] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.221670] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.221754] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fee7d044-53f7-49bc-987e-d9e28c0c329b already deleted. [ 1001.221860] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fee7d044-53f7-49bc-987e-d9e28c0c329b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.239135] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f in Status: SUCCESS [ 1001.239404] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f2ac94a-4beb-4e79-8490-47989224cf9f deletion is rescheduled due to dependency. [ 1001.239592] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f2ac94a-4beb-4e79-8490-47989224cf9f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.849992] env[67094]: INFO networking_nsxv3.common.synchronization [req-2ad5d6ac-5f16-4605-ae5f-dd5a9f87a1a8 req-cb175788-61d0-46e5-bfb2-8ebfcbf6fe10 tempest-InstanceActionsTestJSON-1306434726 tempest-InstanceActionsTestJSON-1306434726-project-member] Enqueued Resource ID: 04d0f31c-3c4e-40ac-a405-c43379f06123 with Priority: HIGHEST for action security_group_members [ 1001.850636] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04d0f31c-3c4e-40ac-a405-c43379f06123 with Priority: HIGHEST for action security_group_members [ 1001.851608] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-04d0f31c-3c4e-40ac-a405-c43379f06123 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.851780] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04d0f31c-3c4e-40ac-a405-c43379f06123" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.851855] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04d0f31c-3c4e-40ac-a405-c43379f06123" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.852120] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04d0f31c-3c4e-40ac-a405-c43379f06123" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.852294] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1001.852390] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1001.852450] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1001.852600] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1001.852684] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1001.853404] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04d0f31c-3c4e-40ac-a405-c43379f06123',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.311659] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock network-370 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.311865] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "network-370" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.312038] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "network-370" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.312401] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "network-370" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.312915] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.312915] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.313068] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.313169] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.313321] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.313550] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1002.313662] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1002.313769] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1002.313871] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1002.313976] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1002.314091] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1002.314215] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1002.341650] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1002.341718] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1002.341862] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1002.342118] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "network-370" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.345018] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock port-ec043701-1be2-4f81-9a70-59f949daf0a4 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.345018] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "port-ec043701-1be2-4f81-9a70-59f949daf0a4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.345018] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "port-ec043701-1be2-4f81-9a70-59f949daf0a4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.345018] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "port-ec043701-1be2-4f81-9a70-59f949daf0a4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.345018] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec043701-1be2-4f81-9a70-59f949daf0a4',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.355689] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.356147] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.356147] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.356405] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.356405] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.356477] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.356638] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.356638] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.356798] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.356869] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.356955] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04d0f31c-3c4e-40ac-a405-c43379f06123 already deleted. [ 1002.357109] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04d0f31c-3c4e-40ac-a405-c43379f06123" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.774925] env[67094]: INFO networking_nsxv3.common.synchronization [None req-76a53ed0-a629-4f94-a0e1-246c7f9c7668 tempest-AttachVolumeNegativeTest-737516548 tempest-AttachVolumeNegativeTest-737516548-project-member] Enqueued Resource ID: 7e9a1130-f6aa-45df-b627-3bebf6cbd9ff with Priority: HIGHEST for action security_group_rules [ 1002.775597] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e9a1130-f6aa-45df-b627-3bebf6cbd9ff with Priority: HIGHEST for action security_group_rules [ 1002.776085] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e9a1130-f6aa-45df-b627-3bebf6cbd9ff taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.776173] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e9a1130-f6aa-45df-b627-3bebf6cbd9ff" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.776232] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e9a1130-f6aa-45df-b627-3bebf6cbd9ff" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.780339] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e9a1130-f6aa-45df-b627-3bebf6cbd9ff" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.780443] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e9a1130-f6aa-45df-b627-3bebf6cbd9ff',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1002.848610] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.848844] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.848973] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.849287] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.849443] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.849629] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Segment Port ec043701-1be2-4f81-9a70-59f949daf0a4 not found, creating... [ 1002.849894] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.850067] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.850294] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.850403] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.850604] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.850967] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.851467] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.851602] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.851819] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.851960] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.852115] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Resource: SegmentPort with ID: ec043701-1be2-4f81-9a70-59f949daf0a4 is going to be created. [ 1002.872810] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1002.873040] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1002.873611] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1002.873611] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1002.873851] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1002.873965] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "port-ec043701-1be2-4f81-9a70-59f949daf0a4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.291427] env[67094]: INFO networking_nsxv3.common.synchronization [None req-dfa9492b-ae16-4ccd-86b4-9e1981a12e57 tempest-AttachVolumeNegativeTest-737516548 tempest-AttachVolumeNegativeTest-737516548-project-member] Enqueued Resource ID: 7e9a1130-f6aa-45df-b627-3bebf6cbd9ff with Priority: HIGHEST for action security_group_rules [ 1003.292223] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e9a1130-f6aa-45df-b627-3bebf6cbd9ff with Priority: HIGHEST for action security_group_rules [ 1003.292223] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e9a1130-f6aa-45df-b627-3bebf6cbd9ff taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.292223] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e9a1130-f6aa-45df-b627-3bebf6cbd9ff" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.301255] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.301255] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.301255] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.301255] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.301541] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.301541] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e9a1130-f6aa-45df-b627-3bebf6cbd9ff already deleted. [ 1003.301541] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e9a1130-f6aa-45df-b627-3bebf6cbd9ff" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.301713] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e9a1130-f6aa-45df-b627-3bebf6cbd9ff" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.303303] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e9a1130-f6aa-45df-b627-3bebf6cbd9ff" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.303303] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e9a1130-f6aa-45df-b627-3bebf6cbd9ff',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.575014] env[67094]: INFO networking_nsxv3.common.synchronization [None req-b105ae82-4fbd-4224-8c78-c5b1a95631a3 None None] Enqueued Resource ID: 918837b3-4c90-42b9-b830-dac37f46d9b7 with Priority: HIGHEST for action port [ 1003.575498] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 918837b3-4c90-42b9-b830-dac37f46d9b7 with Priority: HIGHEST for action port [ 1003.575867] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-918837b3-4c90-42b9-b830-dac37f46d9b7 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.580338] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-918837b3-4c90-42b9-b830-dac37f46d9b7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.580532] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-918837b3-4c90-42b9-b830-dac37f46d9b7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.582199] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-918837b3-4c90-42b9-b830-dac37f46d9b7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.582408] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('918837b3-4c90-42b9-b830-dac37f46d9b7',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.653427] env[67094]: INFO networking_nsxv3.common.synchronization [req-2ad5d6ac-5f16-4605-ae5f-dd5a9f87a1a8 req-c142444e-c3a2-4ecc-b750-f464c8ba5ad0 service nova] Enqueued Resource ID: 04d0f31c-3c4e-40ac-a405-c43379f06123 with Priority: HIGHEST for action security_group_rules [ 1003.653612] env[67094]: INFO networking_nsxv3.common.synchronization [req-2ad5d6ac-5f16-4605-ae5f-dd5a9f87a1a8 req-c142444e-c3a2-4ecc-b750-f464c8ba5ad0 service nova] Enqueued Resource ID: 04d0f31c-3c4e-40ac-a405-c43379f06123 with Priority: HIGHEST for action security_group_members [ 1003.653750] env[67094]: INFO networking_nsxv3.common.synchronization [req-2ad5d6ac-5f16-4605-ae5f-dd5a9f87a1a8 req-c142444e-c3a2-4ecc-b750-f464c8ba5ad0 service nova] Enqueued Resource ID: ec043701-1be2-4f81-9a70-59f949daf0a4 with Priority: HIGHEST for action port [ 1003.654341] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04d0f31c-3c4e-40ac-a405-c43379f06123 with Priority: HIGHEST for action security_group_rules [ 1003.654603] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04d0f31c-3c4e-40ac-a405-c43379f06123 with Priority: HIGHEST for action security_group_members [ 1003.654603] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ec043701-1be2-4f81-9a70-59f949daf0a4 with Priority: HIGHEST for action port [ 1003.654861] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-04d0f31c-3c4e-40ac-a405-c43379f06123 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.654983] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-04d0f31c-3c4e-40ac-a405-c43379f06123" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.656614] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-04d0f31c-3c4e-40ac-a405-c43379f06123" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.656614] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-04d0f31c-3c4e-40ac-a405-c43379f06123" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.656614] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('04d0f31c-3c4e-40ac-a405-c43379f06123',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.657945] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-04d0f31c-3c4e-40ac-a405-c43379f06123 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.658167] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04d0f31c-3c4e-40ac-a405-c43379f06123" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.658500] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04d0f31c-3c4e-40ac-a405-c43379f06123" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.659135] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04d0f31c-3c4e-40ac-a405-c43379f06123" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.659909] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.660266] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.660389] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.660692] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.663812] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.663812] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04d0f31c-3c4e-40ac-a405-c43379f06123',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.663812] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-ec043701-1be2-4f81-9a70-59f949daf0a4 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.663812] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ec043701-1be2-4f81-9a70-59f949daf0a4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.663812] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ec043701-1be2-4f81-9a70-59f949daf0a4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.663812] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ec043701-1be2-4f81-9a70-59f949daf0a4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.663812] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ec043701-1be2-4f81-9a70-59f949daf0a4',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1003.828289] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1003.828711] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1003.828711] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1003.831952] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1003.831952] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1003.831952] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e9a1130-f6aa-45df-b627-3bebf6cbd9ff already deleted. [ 1003.831952] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e9a1130-f6aa-45df-b627-3bebf6cbd9ff" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.085416] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 918837b3-4c90-42b9-b830-dac37f46d9b7 [ 1004.085655] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.085788] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.085862] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.086087] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.086176] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.086273] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:918837b3-4c90-42b9-b830-dac37f46d9b7 already deleted. [ 1004.086355] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-918837b3-4c90-42b9-b830-dac37f46d9b7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.158376] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-04d0f31c-3c4e-40ac-a405-c43379f06123 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.158923] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04d0f31c-3c4e-40ac-a405-c43379f06123" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.169431] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ec043701-1be2-4f81-9a70-59f949daf0a4 with status ACTIVE [ 1004.169737] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.169924] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.169976] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.170206] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.170338] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.170472] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.170594] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.170679] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.170914] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.171019] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.171214] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.171323] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.171378] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.171522] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.171617] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.172436] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ec043701-1be2-4f81-9a70-59f949daf0a4 is going to be updated. [ 1004.173748] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('04d0f31c-3c4e-40ac-a405-c43379f06123',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.208131] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.208333] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.208367] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.208564] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.208699] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.208858] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ec043701-1be2-4f81-9a70-59f949daf0a4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.676082] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('04d0f31c-3c4e-40ac-a405-c43379f06123',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1004.802876] env[67094]: INFO networking_nsxv3.common.synchronization [req-f5a4e6c7-dcd0-4dea-aa3c-35346239af13 req-15b566aa-ed3d-4e6f-8c59-776c2a5444eb tempest-DeleteServersTestJSON-1237946437 tempest-DeleteServersTestJSON-1237946437-project-member] Enqueued Resource ID: 276c2084-ac8d-475a-af24-a062dc3e17aa with Priority: HIGHEST for action security_group_members [ 1004.803577] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 276c2084-ac8d-475a-af24-a062dc3e17aa with Priority: HIGHEST for action security_group_members [ 1004.803577] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-276c2084-ac8d-475a-af24-a062dc3e17aa taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.803577] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.803577] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.803951] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.804194] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1004.804370] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1004.804453] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1004.804658] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1004.804787] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1004.804913] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('276c2084-ac8d-475a-af24-a062dc3e17aa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.102312] env[67094]: INFO networking_nsxv3.common.synchronization [req-15575239-7fda-44f9-84a7-81c31a970dbc req-fefdc9c0-44d4-455c-8777-20da8a432356 tempest-InstanceActionsV221TestJSON-231057085 tempest-InstanceActionsV221TestJSON-231057085-project-member] Enqueued Resource ID: fa13d7cb-fe19-4ac5-ab31-738acdf72313 with Priority: HIGHEST for action security_group_members [ 1005.102950] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa13d7cb-fe19-4ac5-ab31-738acdf72313 with Priority: HIGHEST for action security_group_members [ 1005.103182] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-fa13d7cb-fe19-4ac5-ab31-738acdf72313 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.103639] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fa13d7cb-fe19-4ac5-ab31-738acdf72313" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.103721] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fa13d7cb-fe19-4ac5-ab31-738acdf72313" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.103928] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fa13d7cb-fe19-4ac5-ab31-738acdf72313" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.104154] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.104265] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.104329] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.104482] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.104569] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.104666] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fa13d7cb-fe19-4ac5-ab31-738acdf72313',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.178523] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.178713] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.178753] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.179051] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.179115] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.179216] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04d0f31c-3c4e-40ac-a405-c43379f06123 is going to be created. [ 1005.203953] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.204119] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.204167] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.204507] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.204507] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.215798] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04d0f31c-3c4e-40ac-a405-c43379f06123 in Status: UNINITIALIZED for 2s [ 1005.308173] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.308173] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.308173] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.308173] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.308173] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.308525] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.308525] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.308525] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.308525] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.308793] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.308793] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 276c2084-ac8d-475a-af24-a062dc3e17aa already deleted. [ 1005.308793] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.584036] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock network-318 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.584036] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "network-318" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.584036] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "network-318" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.584036] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "network-318" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.584036] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.584036] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.584036] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.584527] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.584527] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.584608] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1005.585078] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1005.585078] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1005.585078] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1005.585078] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1005.585380] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1005.585380] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1005.607508] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.607760] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.607848] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.608190] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.608330] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.608716] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.608913] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.609023] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.609286] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.609411] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.609629] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa13d7cb-fe19-4ac5-ab31-738acdf72313 is going to be updated. [ 1005.636698] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1005.640023] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Cache value generated in 0.052 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1005.640023] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1005.640023] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "network-318" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.640023] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock port-1039f93d-11ac-4a79-b55a-51939bb161ed taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.640023] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "port-1039f93d-11ac-4a79-b55a-51939bb161ed" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.640023] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "port-1039f93d-11ac-4a79-b55a-51939bb161ed" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.640023] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "port-1039f93d-11ac-4a79-b55a-51939bb161ed" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.640023] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1039f93d-11ac-4a79-b55a-51939bb161ed',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1005.651483] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1005.651710] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1005.651710] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1005.651928] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1005.652091] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1005.661968] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa13d7cb-fe19-4ac5-ab31-738acdf72313 in Status: IN_PROGRESS for 2s [ 1006.120056] env[67094]: INFO networking_nsxv3.common.synchronization [None req-4c90e4c0-17b1-409e-8347-060b2b1c831e None None] Enqueued Resource ID: 652db906-9173-447d-92f0-59df294b5fc9 with Priority: HIGHEST for action port [ 1006.120766] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 652db906-9173-447d-92f0-59df294b5fc9 with Priority: HIGHEST for action port [ 1006.121052] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-652db906-9173-447d-92f0-59df294b5fc9 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.121734] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-652db906-9173-447d-92f0-59df294b5fc9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.121897] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-652db906-9173-447d-92f0-59df294b5fc9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.122289] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-652db906-9173-447d-92f0-59df294b5fc9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.122405] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('652db906-9173-447d-92f0-59df294b5fc9',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.141743] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.141890] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.141991] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.142296] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.142447] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.142608] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Segment Port 1039f93d-11ac-4a79-b55a-51939bb161ed not found, creating... [ 1006.142915] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.143033] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.143158] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.143394] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.143499] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.143869] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.143999] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.147575] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.147909] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.148104] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.148290] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Resource: SegmentPort with ID: 1039f93d-11ac-4a79-b55a-51939bb161ed is going to be created. [ 1006.174864] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.175178] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.175339] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.175586] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.175815] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.176109] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "port-1039f93d-11ac-4a79-b55a-51939bb161ed" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.624532] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 652db906-9173-447d-92f0-59df294b5fc9 [ 1006.625178] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.625178] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.625178] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.625315] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.625406] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.626223] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:652db906-9173-447d-92f0-59df294b5fc9 already deleted. [ 1006.626223] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-652db906-9173-447d-92f0-59df294b5fc9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.717733] env[67094]: INFO networking_nsxv3.common.synchronization [req-8b60d8dd-08f8-463f-9ba5-8769ecf3c4c9 req-f5e13df3-519b-45ba-a01e-a75ebd16379f tempest-ServerRescueTestJSON-685643514 tempest-ServerRescueTestJSON-685643514-project-member] Enqueued Resource ID: 3ece2d85-d26d-4c59-ae47-b9a59cc4de8f with Priority: HIGHEST for action security_group_members [ 1006.718324] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ece2d85-d26d-4c59-ae47-b9a59cc4de8f with Priority: HIGHEST for action security_group_members [ 1006.718645] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-3ece2d85-d26d-4c59-ae47-b9a59cc4de8f taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.718765] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3ece2d85-d26d-4c59-ae47-b9a59cc4de8f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.718831] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3ece2d85-d26d-4c59-ae47-b9a59cc4de8f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.719136] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3ece2d85-d26d-4c59-ae47-b9a59cc4de8f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.719319] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.719546] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.721491] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.721834] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.721952] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.722168] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3ece2d85-d26d-4c59-ae47-b9a59cc4de8f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.940917] env[67094]: INFO networking_nsxv3.common.synchronization [req-f5a4e6c7-dcd0-4dea-aa3c-35346239af13 req-b8edf8e2-5f31-4ad6-bc67-50e725c7871f service nova] Enqueued Resource ID: 276c2084-ac8d-475a-af24-a062dc3e17aa with Priority: HIGHEST for action security_group_rules [ 1006.941111] env[67094]: INFO networking_nsxv3.common.synchronization [req-f5a4e6c7-dcd0-4dea-aa3c-35346239af13 req-b8edf8e2-5f31-4ad6-bc67-50e725c7871f service nova] Enqueued Resource ID: 276c2084-ac8d-475a-af24-a062dc3e17aa with Priority: HIGHEST for action security_group_members [ 1006.941252] env[67094]: INFO networking_nsxv3.common.synchronization [req-f5a4e6c7-dcd0-4dea-aa3c-35346239af13 req-b8edf8e2-5f31-4ad6-bc67-50e725c7871f service nova] Enqueued Resource ID: 1039f93d-11ac-4a79-b55a-51939bb161ed with Priority: HIGHEST for action port [ 1006.942050] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 276c2084-ac8d-475a-af24-a062dc3e17aa with Priority: HIGHEST for action security_group_rules [ 1006.942050] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 276c2084-ac8d-475a-af24-a062dc3e17aa with Priority: HIGHEST for action security_group_members [ 1006.942050] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1039f93d-11ac-4a79-b55a-51939bb161ed with Priority: HIGHEST for action port [ 1006.942911] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-276c2084-ac8d-475a-af24-a062dc3e17aa taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.943088] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.943190] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.943609] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.943722] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('276c2084-ac8d-475a-af24-a062dc3e17aa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.945081] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-276c2084-ac8d-475a-af24-a062dc3e17aa taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.945081] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.945081] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.945263] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.945396] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.945491] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.945562] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.945701] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.945808] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1006.945871] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('276c2084-ac8d-475a-af24-a062dc3e17aa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1006.948735] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-1039f93d-11ac-4a79-b55a-51939bb161ed taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1006.948735] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1039f93d-11ac-4a79-b55a-51939bb161ed" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1006.948735] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1039f93d-11ac-4a79-b55a-51939bb161ed" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1006.948735] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1039f93d-11ac-4a79-b55a-51939bb161ed" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1006.948735] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1039f93d-11ac-4a79-b55a-51939bb161ed',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.026610] env[67094]: INFO networking_nsxv3.common.synchronization [req-b48c925b-a80b-4317-b460-3ff9ad6f283a req-909ce99f-fdff-4c28-b1db-1e63f8474af1 tempest-ServerDiskConfigTestJSON-51233165 tempest-ServerDiskConfigTestJSON-51233165-project-member] Enqueued Resource ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 with Priority: HIGHEST for action security_group_members [ 1007.030018] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 with Priority: HIGHEST for action security_group_members [ 1007.030018] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.030018] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.030018] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.030018] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.030018] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.030018] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.030018] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.030018] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.030018] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.030018] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.225744] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.226271] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.226271] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.226271] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.226388] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.226551] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.226781] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.226781] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.227041] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.227109] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.227167] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ece2d85-d26d-4c59-ae47-b9a59cc4de8f is going to be updated. [ 1007.231537] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04d0f31c-3c4e-40ac-a405-c43379f06123 in Status: UNINITIALIZED for 4s [ 1007.260095] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.260646] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.260733] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.261011] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.261119] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.271371] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ece2d85-d26d-4c59-ae47-b9a59cc4de8f in Status: IN_PROGRESS for 2s [ 1007.453020] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-276c2084-ac8d-475a-af24-a062dc3e17aa taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.453020] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.453020] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('276c2084-ac8d-475a-af24-a062dc3e17aa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.453020] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1039f93d-11ac-4a79-b55a-51939bb161ed with status ACTIVE [ 1007.453020] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.453020] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.453020] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.453020] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.453020] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.453020] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.453020] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.453020] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.453020] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.453020] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.453772] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.453772] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.453772] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.453772] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.453772] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.453772] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1039f93d-11ac-4a79-b55a-51939bb161ed is going to be updated. [ 1007.476763] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.478152] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.478152] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.478152] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.478152] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.478152] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1039f93d-11ac-4a79-b55a-51939bb161ed" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.535441] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.535441] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.535441] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.535441] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.535441] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.535441] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.535441] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.535441] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.535441] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.535441] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.535441] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 is going to be updated. [ 1007.541191] env[67094]: INFO networking_nsxv3.common.synchronization [req-7aec72cb-5bac-4cea-b1e6-4428ae803694 req-576ec5f6-b3ed-4aed-883d-5a25f11d8cc7 tempest-ServersTestJSON-1070791530 tempest-ServersTestJSON-1070791530-project-member] Enqueued Resource ID: c0881101-1be1-4dbf-ac18-2d54a689202c with Priority: HIGHEST for action security_group_members [ 1007.541682] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0881101-1be1-4dbf-ac18-2d54a689202c with Priority: HIGHEST for action security_group_members [ 1007.541990] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0881101-1be1-4dbf-ac18-2d54a689202c taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.542127] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.542193] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.542389] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.542537] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.542634] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.542695] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.542841] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.542922] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.543024] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1007.573736] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1007.573938] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1007.573938] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1007.574183] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1007.574324] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.597993] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 in Status: IN_PROGRESS for 2s [ 1007.672660] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fa13d7cb-fe19-4ac5-ab31-738acdf72313 in Status: SUCCESS [ 1007.672864] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fa13d7cb-fe19-4ac5-ab31-738acdf72313 deletion is rescheduled due to dependency. [ 1007.673059] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fa13d7cb-fe19-4ac5-ab31-738acdf72313" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1007.956556] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('276c2084-ac8d-475a-af24-a062dc3e17aa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.045037] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.089935] env[67094]: INFO networking_nsxv3.common.synchronization [req-143a5b12-6dcb-4529-9d14-9b1584b58320 req-cfeecc98-43b9-421a-87bb-c8dde7fe7979 tempest-AttachInterfacesTestJSON-1117082489 tempest-AttachInterfacesTestJSON-1117082489-project-member] Enqueued Resource ID: 882c69d3-9554-45c6-97a1-55fb0f065040 with Priority: HIGHEST for action security_group_members [ 1008.090843] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 882c69d3-9554-45c6-97a1-55fb0f065040 with Priority: HIGHEST for action security_group_members [ 1008.090976] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-882c69d3-9554-45c6-97a1-55fb0f065040 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.093268] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.093393] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.093715] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.093906] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.094044] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.094145] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.094288] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.094375] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.095259] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('882c69d3-9554-45c6-97a1-55fb0f065040',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.215205] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock network-91 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.215531] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "network-91" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.215803] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "network-91" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.216184] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "network-91" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.216514] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.217054] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.217054] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.217285] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.217433] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.217696] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1008.217834] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1008.217962] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1008.218127] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1008.218316] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1008.218419] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1008.218579] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1008.239199] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1008.239766] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1008.239766] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1008.239896] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "network-91" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.240283] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock port-d76853b4-89cd-44d5-8d9b-9b99963ecaa0 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.240770] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "port-d76853b4-89cd-44d5-8d9b-9b99963ecaa0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.240770] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "port-d76853b4-89cd-44d5-8d9b-9b99963ecaa0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.241108] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "port-d76853b4-89cd-44d5-8d9b-9b99963ecaa0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.241302] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d76853b4-89cd-44d5-8d9b-9b99963ecaa0',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.463568] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.463568] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.463568] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.463568] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.463568] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.463568] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 276c2084-ac8d-475a-af24-a062dc3e17aa is going to be created. [ 1008.486214] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.486214] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.486214] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.486214] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.486214] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.496325] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 276c2084-ac8d-475a-af24-a062dc3e17aa in Status: UNINITIALIZED for 2s [ 1008.548681] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.598275] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('882c69d3-9554-45c6-97a1-55fb0f065040',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1008.744226] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.745766] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.745766] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.745766] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.745766] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.745766] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Segment Port d76853b4-89cd-44d5-8d9b-9b99963ecaa0 not found, creating... [ 1008.745766] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.746062] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.746062] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.747033] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.747033] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.747033] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.747033] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.747033] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.747500] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.747681] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.747859] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Resource: SegmentPort with ID: d76853b4-89cd-44d5-8d9b-9b99963ecaa0 is going to be created. [ 1008.769064] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.769376] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.769632] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.769914] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.770210] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.770532] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "port-d76853b4-89cd-44d5-8d9b-9b99963ecaa0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1008.910220] env[67094]: INFO networking_nsxv3.common.synchronization [None req-cae9d25a-d374-439d-aa82-28ec866b6bf8 None None] Enqueued Resource ID: 7c00fd2f-2df0-47be-8043-0ffc24edd89d with Priority: HIGHEST for action port [ 1008.910220] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7c00fd2f-2df0-47be-8043-0ffc24edd89d with Priority: HIGHEST for action port [ 1008.910220] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-7c00fd2f-2df0-47be-8043-0ffc24edd89d taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1008.910413] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-7c00fd2f-2df0-47be-8043-0ffc24edd89d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1008.910602] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-7c00fd2f-2df0-47be-8043-0ffc24edd89d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1008.910972] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-7c00fd2f-2df0-47be-8043-0ffc24edd89d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1008.911167] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('7c00fd2f-2df0-47be-8043-0ffc24edd89d',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.052991] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.056404] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.056404] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.056404] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.056404] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.056404] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0881101-1be1-4dbf-ac18-2d54a689202c is going to be updated. [ 1009.088399] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.088548] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.088622] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.089106] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.089106] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.099300] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0881101-1be1-4dbf-ac18-2d54a689202c in Status: IN_PROGRESS for 2s [ 1009.100405] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('882c69d3-9554-45c6-97a1-55fb0f065040',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.242726] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04d0f31c-3c4e-40ac-a405-c43379f06123 in Status: SUCCESS [ 1009.242726] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04d0f31c-3c4e-40ac-a405-c43379f06123" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.242726] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04d0f31c-3c4e-40ac-a405-c43379f06123" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.242726] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04d0f31c-3c4e-40ac-a405-c43379f06123" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.242726] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.242726] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.242726] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.242726] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.242726] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.242726] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04d0f31c-3c4e-40ac-a405-c43379f06123" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.242726] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('04d0f31c-3c4e-40ac-a405-c43379f06123',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.282733] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3ece2d85-d26d-4c59-ae47-b9a59cc4de8f in Status: SUCCESS [ 1009.282931] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3ece2d85-d26d-4c59-ae47-b9a59cc4de8f deletion is rescheduled due to dependency. [ 1009.283065] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3ece2d85-d26d-4c59-ae47-b9a59cc4de8f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.415185] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 7c00fd2f-2df0-47be-8043-0ffc24edd89d [ 1009.415185] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.415185] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.415185] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.415185] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.415185] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.415185] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:7c00fd2f-2df0-47be-8043-0ffc24edd89d already deleted. [ 1009.415185] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-7c00fd2f-2df0-47be-8043-0ffc24edd89d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.519693] env[67094]: INFO networking_nsxv3.common.synchronization [req-7aec72cb-5bac-4cea-b1e6-4428ae803694 req-10932334-9274-431f-850b-94a062162289 service nova] Enqueued Resource ID: c0881101-1be1-4dbf-ac18-2d54a689202c with Priority: HIGHEST for action security_group_rules [ 1009.519693] env[67094]: INFO networking_nsxv3.common.synchronization [req-7aec72cb-5bac-4cea-b1e6-4428ae803694 req-10932334-9274-431f-850b-94a062162289 service nova] Enqueued Resource ID: c0881101-1be1-4dbf-ac18-2d54a689202c with Priority: HIGHEST for action security_group_members [ 1009.519693] env[67094]: INFO networking_nsxv3.common.synchronization [req-7aec72cb-5bac-4cea-b1e6-4428ae803694 req-10932334-9274-431f-850b-94a062162289 service nova] Enqueued Resource ID: d76853b4-89cd-44d5-8d9b-9b99963ecaa0 with Priority: HIGHEST for action port [ 1009.520338] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0881101-1be1-4dbf-ac18-2d54a689202c with Priority: HIGHEST for action security_group_rules [ 1009.521219] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0881101-1be1-4dbf-ac18-2d54a689202c with Priority: HIGHEST for action security_group_members [ 1009.521315] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d76853b4-89cd-44d5-8d9b-9b99963ecaa0 with Priority: HIGHEST for action port [ 1009.521702] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0881101-1be1-4dbf-ac18-2d54a689202c taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.521804] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.522045] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.522132] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.522220] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.523578] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0881101-1be1-4dbf-ac18-2d54a689202c taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.523578] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.526576] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-d76853b4-89cd-44d5-8d9b-9b99963ecaa0 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.526576] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d76853b4-89cd-44d5-8d9b-9b99963ecaa0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.526576] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d76853b4-89cd-44d5-8d9b-9b99963ecaa0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.526576] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d76853b4-89cd-44d5-8d9b-9b99963ecaa0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.526576] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d76853b4-89cd-44d5-8d9b-9b99963ecaa0',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1009.606962] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.606962] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.606962] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.606962] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.606962] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.606962] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 882c69d3-9554-45c6-97a1-55fb0f065040 is going to be updated. [ 1009.609774] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 in Status: SUCCESS [ 1009.609774] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 deletion is rescheduled due to dependency. [ 1009.609774] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.636335] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.636513] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.636565] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.636769] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.636914] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.647908] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882c69d3-9554-45c6-97a1-55fb0f065040 in Status: IN_PROGRESS for 2s [ 1009.748279] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-04d0f31c-3c4e-40ac-a405-c43379f06123 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.748279] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04d0f31c-3c4e-40ac-a405-c43379f06123" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.748540] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04d0f31c-3c4e-40ac-a405-c43379f06123" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.748540] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04d0f31c-3c4e-40ac-a405-c43379f06123" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.748717] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.748814] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.748875] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.749030] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.749115] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.749201] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04d0f31c-3c4e-40ac-a405-c43379f06123" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.749739] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-04d0f31c-3c4e-40ac-a405-c43379f06123 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.749739] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04d0f31c-3c4e-40ac-a405-c43379f06123" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.749739] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04d0f31c-3c4e-40ac-a405-c43379f06123" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.749966] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04d0f31c-3c4e-40ac-a405-c43379f06123" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.750083] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1009.750149] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1009.750203] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1009.750366] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1009.750455] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.750573] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04d0f31c-3c4e-40ac-a405-c43379f06123" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1009.751875] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('04d0f31c-3c4e-40ac-a405-c43379f06123',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.027198] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0881101-1be1-4dbf-ac18-2d54a689202c taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.027198] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.028957] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d76853b4-89cd-44d5-8d9b-9b99963ecaa0 with status ACTIVE [ 1010.029245] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.029471] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.029613] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.029849] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.029942] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.030146] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.030246] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.030308] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.030460] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.030628] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.030995] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.030995] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.030995] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.031183] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.031258] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.031341] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d76853b4-89cd-44d5-8d9b-9b99963ecaa0 is going to be updated. [ 1010.058564] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.058947] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.059057] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.059273] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.059419] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.059667] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d76853b4-89cd-44d5-8d9b-9b99963ecaa0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.253212] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 04d0f31c-3c4e-40ac-a405-c43379f06123: rpc.has_security_group_logging(os_id): False [ 1010.274846] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.275039] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.275876] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.275876] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.275876] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.275876] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.276152] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.276152] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.276283] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.276402] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.276796] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.279281] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.279281] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.279281] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.279281] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.279281] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.279281] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.279281] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.279281] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.279281] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.279281] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 04d0f31c-3c4e-40ac-a405-c43379f06123 is going to be created. [ 1010.374168] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.374397] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.374397] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.374674] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.374766] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.389800] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 04d0f31c-3c4e-40ac-a405-c43379f06123 in Status: IN_PROGRESS for 2s [ 1010.509593] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 276c2084-ac8d-475a-af24-a062dc3e17aa in Status: SUCCESS [ 1010.510014] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.510194] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.510429] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.510633] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.510753] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.510821] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1010.510986] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1010.511084] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.511179] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1010.511284] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('276c2084-ac8d-475a-af24-a062dc3e17aa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1010.536765] env[67094]: INFO networking_nsxv3.common.synchronization [None req-9a0cb351-356e-4466-8c27-0a336a2b9f15 tempest-AttachInterfacesTestJSON-1117082489 tempest-AttachInterfacesTestJSON-1117082489-project-member] Enqueued Resource ID: 882c69d3-9554-45c6-97a1-55fb0f065040 with Priority: HIGHEST for action security_group_members [ 1010.537334] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 882c69d3-9554-45c6-97a1-55fb0f065040 with Priority: HIGHEST for action security_group_members [ 1010.537677] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-882c69d3-9554-45c6-97a1-55fb0f065040 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1010.537798] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1010.606545] env[67094]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] NSXv3 Agent Agent loop - iteration:1 completed [ 1010.606719] env[67094]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] NSXv3 Agent Agent loop - iteration:2 started [ 1011.013742] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-276c2084-ac8d-475a-af24-a062dc3e17aa taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.013910] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.013986] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.014236] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.014411] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.014510] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.014576] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.015015] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.015175] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.015354] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.015581] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-276c2084-ac8d-475a-af24-a062dc3e17aa taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.015677] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.015762] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.015919] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.016079] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.016169] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.016231] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.016371] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.016447] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.016530] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.016619] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('276c2084-ac8d-475a-af24-a062dc3e17aa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.110905] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0881101-1be1-4dbf-ac18-2d54a689202c in Status: SUCCESS [ 1011.111669] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.111939] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.112617] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.112617] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.112617] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.112617] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.112966] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.112966] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.112966] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.443431] env[67094]: INFO networking_nsxv3.common.synchronization [req-ffa0761e-b022-4cf9-9392-53a0520f971e req-44306ef2-5045-4093-9aac-9211e8f9c105 tempest-ServerActionsTestOtherA-276518123 tempest-ServerActionsTestOtherA-276518123-project-member] Enqueued Resource ID: 4ec74abc-987a-4435-8c42-e7e606ef3293 with Priority: HIGHEST for action security_group_members [ 1011.444173] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ec74abc-987a-4435-8c42-e7e606ef3293 with Priority: HIGHEST for action security_group_members [ 1011.445510] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ec74abc-987a-4435-8c42-e7e606ef3293 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.445510] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ec74abc-987a-4435-8c42-e7e606ef3293" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.445510] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ec74abc-987a-4435-8c42-e7e606ef3293" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.445819] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ec74abc-987a-4435-8c42-e7e606ef3293" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.446282] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.446462] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.446567] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.447178] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.447178] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.447304] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ec74abc-987a-4435-8c42-e7e606ef3293',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.519741] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 276c2084-ac8d-475a-af24-a062dc3e17aa: rpc.has_security_group_logging(os_id): False [ 1011.540024] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.540024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.540024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.540024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.540024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.540024] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.540024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.540024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.540024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.540024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.540831] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.540831] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.540831] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.540831] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.540831] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.541000] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.541000] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.541088] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.541386] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.541386] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.541386] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 276c2084-ac8d-475a-af24-a062dc3e17aa is going to be created. [ 1011.608032] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.608032] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.608291] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.610582] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.610933] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.616716] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.636130] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 276c2084-ac8d-475a-af24-a062dc3e17aa in Status: IN_PROGRESS for 2s [ 1011.662544] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882c69d3-9554-45c6-97a1-55fb0f065040 in Status: SUCCESS [ 1011.662544] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.662544] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.662544] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.662847] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.662847] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.662963] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.663085] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.663194] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.663320] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('882c69d3-9554-45c6-97a1-55fb0f065040',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1011.951562] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.951780] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.951881] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.952146] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.952243] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.952461] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1011.952561] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1011.952625] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1011.952777] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1011.952851] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1011.952933] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ec74abc-987a-4435-8c42-e7e606ef3293 already deleted. [ 1011.953026] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ec74abc-987a-4435-8c42-e7e606ef3293" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.026288] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock network-997 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.026288] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "network-997" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.026288] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "network-997" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.026288] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "network-997" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.026800] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.026800] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.028409] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.028409] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.028409] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.028409] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1012.028409] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1012.028409] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1012.028778] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1012.028778] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1012.028879] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1012.028984] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1012.052932] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1012.053189] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1012.053283] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1012.053654] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "network-997" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.053799] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock port-1f288474-c63e-4e4f-b563-661d1e6d8712 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.054251] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "port-1f288474-c63e-4e4f-b563-661d1e6d8712" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.054251] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "port-1f288474-c63e-4e4f-b563-661d1e6d8712" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.054548] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "port-1f288474-c63e-4e4f-b563-661d1e6d8712" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.054611] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f288474-c63e-4e4f-b563-661d1e6d8712',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.123862] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1012.167672] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.167825] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.167896] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.168321] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.168321] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.168440] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.168519] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.168558] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.168772] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.168919] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.169055] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 882c69d3-9554-45c6-97a1-55fb0f065040 is going to be updated. [ 1012.201457] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.201457] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.201457] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.201774] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.201998] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.211227] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882c69d3-9554-45c6-97a1-55fb0f065040 in Status: IN_PROGRESS for 2s [ 1012.406418] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 04d0f31c-3c4e-40ac-a405-c43379f06123 in Status: SUCCESS [ 1012.407300] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-04d0f31c-3c4e-40ac-a405-c43379f06123" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.559270] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.559753] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.559753] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.560017] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.560170] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.560328] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Segment Port 1f288474-c63e-4e4f-b563-661d1e6d8712 not found, creating... [ 1012.560592] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.560757] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.560868] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.561098] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.561235] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.561513] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.561667] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.561784] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.562024] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.562165] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.562304] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Resource: SegmentPort with ID: 1f288474-c63e-4e4f-b563-661d1e6d8712 is going to be created. [ 1012.584919] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.585305] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.585525] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.585820] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.586169] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.586766] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "port-1f288474-c63e-4e4f-b563-661d1e6d8712" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.626353] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.626562] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.626562] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.626803] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.626881] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.626969] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0881101-1be1-4dbf-ac18-2d54a689202c is going to be updated. [ 1012.689615] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1012.689615] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1012.689615] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1012.690724] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1012.690724] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1012.705727] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0881101-1be1-4dbf-ac18-2d54a689202c in Status: IN_PROGRESS for 2s [ 1013.308673] env[67094]: INFO networking_nsxv3.common.synchronization [req-ffa0761e-b022-4cf9-9392-53a0520f971e req-ce1a26d4-3e14-4251-a936-7654218055d9 service nova] Enqueued Resource ID: 4ec74abc-987a-4435-8c42-e7e606ef3293 with Priority: HIGHEST for action security_group_rules [ 1013.308953] env[67094]: INFO networking_nsxv3.common.synchronization [req-ffa0761e-b022-4cf9-9392-53a0520f971e req-ce1a26d4-3e14-4251-a936-7654218055d9 service nova] Enqueued Resource ID: 4ec74abc-987a-4435-8c42-e7e606ef3293 with Priority: HIGHEST for action security_group_members [ 1013.309161] env[67094]: INFO networking_nsxv3.common.synchronization [req-ffa0761e-b022-4cf9-9392-53a0520f971e req-ce1a26d4-3e14-4251-a936-7654218055d9 service nova] Enqueued Resource ID: 1f288474-c63e-4e4f-b563-661d1e6d8712 with Priority: HIGHEST for action port [ 1013.309769] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ec74abc-987a-4435-8c42-e7e606ef3293 with Priority: HIGHEST for action security_group_rules [ 1013.309981] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ec74abc-987a-4435-8c42-e7e606ef3293 with Priority: HIGHEST for action security_group_members [ 1013.310161] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1f288474-c63e-4e4f-b563-661d1e6d8712 with Priority: HIGHEST for action port [ 1013.310581] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4ec74abc-987a-4435-8c42-e7e606ef3293 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.310700] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4ec74abc-987a-4435-8c42-e7e606ef3293" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.310827] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4ec74abc-987a-4435-8c42-e7e606ef3293" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.311077] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4ec74abc-987a-4435-8c42-e7e606ef3293" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.311213] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4ec74abc-987a-4435-8c42-e7e606ef3293',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.312405] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ec74abc-987a-4435-8c42-e7e606ef3293 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.312405] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ec74abc-987a-4435-8c42-e7e606ef3293" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.312519] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ec74abc-987a-4435-8c42-e7e606ef3293" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.312637] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ec74abc-987a-4435-8c42-e7e606ef3293" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.312785] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.312877] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.312937] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.313089] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.313172] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.313260] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ec74abc-987a-4435-8c42-e7e606ef3293',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.314460] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-1f288474-c63e-4e4f-b563-661d1e6d8712 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.314588] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-1f288474-c63e-4e4f-b563-661d1e6d8712" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.314636] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-1f288474-c63e-4e4f-b563-661d1e6d8712" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.316539] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-1f288474-c63e-4e4f-b563-661d1e6d8712" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.316692] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('1f288474-c63e-4e4f-b563-661d1e6d8712',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.459946] env[67094]: INFO networking_nsxv3.common.synchronization [None req-7c3b51f0-ba48-434b-929a-00c056ea554b tempest-ServersV294TestFqdnHostnames-2045593341 tempest-ServersV294TestFqdnHostnames-2045593341-project-member] Enqueued Resource ID: 3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56 with Priority: HIGHEST for action security_group_rules [ 1013.460635] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56 with Priority: HIGHEST for action security_group_rules [ 1013.460977] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.461205] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.461303] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.461616] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.461721] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.651095] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 276c2084-ac8d-475a-af24-a062dc3e17aa in Status: SUCCESS [ 1013.651463] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.818584] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ec74abc-987a-4435-8c42-e7e606ef3293 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.818823] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ec74abc-987a-4435-8c42-e7e606ef3293" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.818902] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('4ec74abc-987a-4435-8c42-e7e606ef3293',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1013.822506] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 1f288474-c63e-4e4f-b563-661d1e6d8712 with status ACTIVE [ 1013.822695] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.822839] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.822908] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.823127] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.823219] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.823389] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.823486] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.823550] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.823971] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.823971] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.823971] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.824117] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.824117] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.824236] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.824310] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.824414] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 1f288474-c63e-4e4f-b563-661d1e6d8712 is going to be updated. [ 1013.845788] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.845991] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.846093] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.846311] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.846497] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.846662] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-1f288474-c63e-4e4f-b563-661d1e6d8712" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.986453] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1013.986453] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1013.986453] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1013.986453] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1013.986453] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1013.986453] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56 already deleted. [ 1013.986453] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.093418] env[67094]: INFO networking_nsxv3.common.synchronization [None req-aac0bbe2-b0f4-4b8f-a4f0-d171c4a80638 tempest-ServersV294TestFqdnHostnames-2045593341 tempest-ServersV294TestFqdnHostnames-2045593341-project-member] Enqueued Resource ID: 3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56 with Priority: HIGHEST for action security_group_rules [ 1014.093418] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56 with Priority: HIGHEST for action security_group_rules [ 1014.093418] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.093418] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.093418] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.093418] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.093418] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.223720] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882c69d3-9554-45c6-97a1-55fb0f065040 in Status: SUCCESS [ 1014.223924] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 882c69d3-9554-45c6-97a1-55fb0f065040 deletion is rescheduled due to dependency. [ 1014.224059] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.321159] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('4ec74abc-987a-4435-8c42-e7e606ef3293',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.613690] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.613940] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.613940] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.614230] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.614354] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.614462] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56 already deleted. [ 1014.614557] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.720533] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0881101-1be1-4dbf-ac18-2d54a689202c in Status: SUCCESS [ 1014.720874] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.721010] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.721233] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.721443] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.721563] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.721628] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.721777] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.721879] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.721980] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.722172] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1014.825282] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.825520] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.825642] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.825878] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.825973] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.826133] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ec74abc-987a-4435-8c42-e7e606ef3293 is going to be created. [ 1014.855023] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1014.855185] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1014.855251] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1014.855495] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1014.855752] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1014.870530] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ec74abc-987a-4435-8c42-e7e606ef3293 in Status: UNINITIALIZED for 2s [ 1015.224348] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0881101-1be1-4dbf-ac18-2d54a689202c taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.224579] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.224647] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.224905] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.225116] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.225207] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.225558] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.225558] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.225713] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.225713] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.225884] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0881101-1be1-4dbf-ac18-2d54a689202c taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.226028] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.226077] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.226311] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.226516] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.226516] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.226632] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.226749] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.226822] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.226919] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.227349] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1015.730952] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c0881101-1be1-4dbf-ac18-2d54a689202c: rpc.has_security_group_logging(os_id): False [ 1015.750781] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.750981] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.751067] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.751294] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.751387] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.751595] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.751724] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.751802] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.752038] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.752106] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.752379] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.752481] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.752481] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.752727] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.752727] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.753023] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.753104] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.753104] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.753313] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.753313] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.753423] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0881101-1be1-4dbf-ac18-2d54a689202c is going to be updated. [ 1015.853275] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1015.853440] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1015.853517] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1015.853732] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1015.853884] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1015.868690] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0881101-1be1-4dbf-ac18-2d54a689202c in Status: IN_PROGRESS for 2s [ 1016.881077] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ec74abc-987a-4435-8c42-e7e606ef3293 in Status: SUCCESS [ 1016.881432] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ec74abc-987a-4435-8c42-e7e606ef3293" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.881474] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ec74abc-987a-4435-8c42-e7e606ef3293" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.881728] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ec74abc-987a-4435-8c42-e7e606ef3293" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.881926] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1016.882123] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1016.882176] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1016.882384] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1016.882384] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.882481] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ec74abc-987a-4435-8c42-e7e606ef3293" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1016.882553] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('4ec74abc-987a-4435-8c42-e7e606ef3293',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.030685] env[67094]: INFO networking_nsxv3.common.synchronization [req-76b71376-ef76-49fa-87fa-fc745ca85411 req-bc160d8c-ce7e-434a-84ab-f97fb7c364ec tempest-AttachInterfacesTestJSON-1117082489 tempest-AttachInterfacesTestJSON-1117082489-project-member] Enqueued Resource ID: 4338a2b6-fa27-47ec-8f93-f4223c009203 with Priority: HIGHEST for action security_group_members [ 1017.031459] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4338a2b6-fa27-47ec-8f93-f4223c009203 with Priority: HIGHEST for action security_group_members [ 1017.031818] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-4338a2b6-fa27-47ec-8f93-f4223c009203 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.031967] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4338a2b6-fa27-47ec-8f93-f4223c009203" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.032113] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4338a2b6-fa27-47ec-8f93-f4223c009203" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.032212] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4338a2b6-fa27-47ec-8f93-f4223c009203" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.032422] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.032509] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.032546] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.032688] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.032885] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.032885] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4338a2b6-fa27-47ec-8f93-f4223c009203',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.385991] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('4ec74abc-987a-4435-8c42-e7e606ef3293',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1017.540029] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.540029] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.540029] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.540029] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.575923] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.576287] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.576427] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.576502] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.576685] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.576793] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.576890] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4338a2b6-fa27-47ec-8f93-f4223c009203 is going to be updated. [ 1017.610011] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.610011] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.610459] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.610459] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.610459] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.622812] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4338a2b6-fa27-47ec-8f93-f4223c009203 in Status: IN_PROGRESS for 2s [ 1017.887079] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0881101-1be1-4dbf-ac18-2d54a689202c in Status: SUCCESS [ 1017.887571] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.888817] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 4ec74abc-987a-4435-8c42-e7e606ef3293: rpc.has_security_group_logging(os_id): False [ 1017.909012] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.909120] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.909120] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.909478] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.909478] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.909979] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.909979] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.910138] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.910219] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.910665] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.910665] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4ec74abc-987a-4435-8c42-e7e606ef3293 is going to be created. [ 1017.982505] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1017.982645] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1017.982719] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1017.982936] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1017.983139] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1017.996439] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4ec74abc-987a-4435-8c42-e7e606ef3293 in Status: IN_PROGRESS for 2s [ 1018.765452] env[67094]: INFO networking_nsxv3.common.synchronization [req-ee6e8b4d-a165-4d13-bf94-54e2c5acccfc req-1a2815ae-9bda-41d0-a36e-b2b38c33db60 tempest-ServerDiskConfigTestJSON-51233165 tempest-ServerDiskConfigTestJSON-51233165-project-member] Enqueued Resource ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 with Priority: HIGHEST for action security_group_members [ 1018.766209] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 with Priority: HIGHEST for action security_group_members [ 1018.766567] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.766708] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.766790] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.767012] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.767765] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1018.767940] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1018.768038] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1018.768230] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1018.768325] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1018.768446] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.272504] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.272815] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.272815] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.272950] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.273054] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.273909] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.273909] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.273909] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.273909] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.273909] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.273909] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 is going to be updated. [ 1019.310214] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.310396] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.310466] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.310717] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.310860] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.322572] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 in Status: IN_PROGRESS for 2s [ 1019.352596] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock network-723 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.352977] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "network-723" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.353192] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "network-723" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.353507] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "network-723" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.353820] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.354082] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.354269] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.354539] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.354737] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.355014] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1019.355395] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1019.355395] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1019.355518] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1019.355652] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1019.355801] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1019.355977] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1019.387201] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1019.387567] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1019.387772] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1019.388163] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "network-723" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.388359] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock port-157a72f5-ef2c-4d84-b388-2e2092833cc3 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.388583] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "port-157a72f5-ef2c-4d84-b388-2e2092833cc3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.388824] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "port-157a72f5-ef2c-4d84-b388-2e2092833cc3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.388972] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "port-157a72f5-ef2c-4d84-b388-2e2092833cc3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.389135] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('157a72f5-ef2c-4d84-b388-2e2092833cc3',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1019.635502] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4338a2b6-fa27-47ec-8f93-f4223c009203 in Status: SUCCESS [ 1019.635502] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4338a2b6-fa27-47ec-8f93-f4223c009203 deletion is rescheduled due to dependency. [ 1019.635502] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4338a2b6-fa27-47ec-8f93-f4223c009203" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.891593] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.891849] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.891951] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.892288] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.892431] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.892589] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Segment Port 157a72f5-ef2c-4d84-b388-2e2092833cc3 not found, creating... [ 1019.892855] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.893126] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.893359] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.893664] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.893819] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.894156] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.894426] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.894647] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.895045] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.895293] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.895537] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Resource: SegmentPort with ID: 157a72f5-ef2c-4d84-b388-2e2092833cc3 is going to be created. [ 1019.920509] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1019.921221] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1019.921221] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1019.921221] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1019.921982] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1019.921982] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "port-157a72f5-ef2c-4d84-b388-2e2092833cc3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.014387] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 4ec74abc-987a-4435-8c42-e7e606ef3293 in Status: SUCCESS [ 1020.014642] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4ec74abc-987a-4435-8c42-e7e606ef3293" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1020.721321] env[67094]: INFO networking_nsxv3.common.synchronization [req-ee6e8b4d-a165-4d13-bf94-54e2c5acccfc req-40070ef7-955b-48a7-8b09-78acb4a890d6 service nova] Enqueued Resource ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 with Priority: HIGHEST for action security_group_rules [ 1020.721613] env[67094]: INFO networking_nsxv3.common.synchronization [req-ee6e8b4d-a165-4d13-bf94-54e2c5acccfc req-40070ef7-955b-48a7-8b09-78acb4a890d6 service nova] Enqueued Resource ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 with Priority: HIGHEST for action security_group_members [ 1020.721871] env[67094]: INFO networking_nsxv3.common.synchronization [req-ee6e8b4d-a165-4d13-bf94-54e2c5acccfc req-40070ef7-955b-48a7-8b09-78acb4a890d6 service nova] Enqueued Resource ID: 157a72f5-ef2c-4d84-b388-2e2092833cc3 with Priority: HIGHEST for action port [ 1020.722899] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 with Priority: HIGHEST for action security_group_rules [ 1020.722899] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 with Priority: HIGHEST for action security_group_members [ 1020.722899] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 157a72f5-ef2c-4d84-b388-2e2092833cc3 with Priority: HIGHEST for action port [ 1020.723745] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.723745] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.723745] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.723745] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.723745] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1020.725703] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.725703] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.726056] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-157a72f5-ef2c-4d84-b388-2e2092833cc3 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1020.726056] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-157a72f5-ef2c-4d84-b388-2e2092833cc3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1020.726210] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-157a72f5-ef2c-4d84-b388-2e2092833cc3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1020.726306] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-157a72f5-ef2c-4d84-b388-2e2092833cc3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1020.727286] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('157a72f5-ef2c-4d84-b388-2e2092833cc3',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.228561] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.228747] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.228895] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 157a72f5-ef2c-4d84-b388-2e2092833cc3 with status ACTIVE [ 1021.229104] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.229389] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.229389] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.229533] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.229579] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.229823] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.229933] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.229997] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.231124] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.231281] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.231606] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.231797] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.231934] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.232235] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.232353] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.232506] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 157a72f5-ef2c-4d84-b388-2e2092833cc3 is going to be updated. [ 1021.260584] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.260937] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.260937] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.261506] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.261506] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.261787] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-157a72f5-ef2c-4d84-b388-2e2092833cc3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.339358] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 in Status: SUCCESS [ 1021.339358] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 deletion is rescheduled due to dependency. [ 1021.339358] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.339358] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.339358] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.339358] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.340731] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.340929] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.344747] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.344747] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.344747] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.661525] env[67094]: INFO networking_nsxv3.common.synchronization [req-987c35d2-b3a3-4d42-a3f8-8c2627aab1b8 req-1c98e181-21cc-4422-a861-33d9b697167d tempest-AttachVolumeNegativeTest-737516548 tempest-AttachVolumeNegativeTest-737516548-project-member] Enqueued Resource ID: 7e9a1130-f6aa-45df-b627-3bebf6cbd9ff with Priority: HIGHEST for action security_group_members [ 1021.662198] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e9a1130-f6aa-45df-b627-3bebf6cbd9ff with Priority: HIGHEST for action security_group_members [ 1021.662798] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e9a1130-f6aa-45df-b627-3bebf6cbd9ff taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.662798] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e9a1130-f6aa-45df-b627-3bebf6cbd9ff" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.662798] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e9a1130-f6aa-45df-b627-3bebf6cbd9ff" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.663537] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e9a1130-f6aa-45df-b627-3bebf6cbd9ff" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.666029] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1021.666029] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1021.666029] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1021.666029] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1021.666029] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1021.666029] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e9a1130-f6aa-45df-b627-3bebf6cbd9ff',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1021.848656] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.353053] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.353053] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.353053] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.353053] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.353053] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.353053] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.353053] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.353053] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.353053] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.353053] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.353053] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e9a1130-f6aa-45df-b627-3bebf6cbd9ff already deleted. [ 1022.353053] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e9a1130-f6aa-45df-b627-3bebf6cbd9ff" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.359081] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.449852] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock network-871 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.450108] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "network-871" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.450240] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "network-871" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.450548] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "network-871" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.450926] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.451077] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.451225] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.451496] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.451732] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.452057] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1022.452253] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1022.452440] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1022.452647] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1022.452860] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1022.453146] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1022.453381] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1022.474602] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1022.474784] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1022.474918] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1022.475105] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "network-871" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.475440] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock port-c5e7bf05-35e5-4efb-a9e9-9f21e2145aad taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.475611] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "port-c5e7bf05-35e5-4efb-a9e9-9f21e2145aad" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.475731] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "port-c5e7bf05-35e5-4efb-a9e9-9f21e2145aad" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.476076] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "port-c5e7bf05-35e5-4efb-a9e9-9f21e2145aad" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.476215] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5e7bf05-35e5-4efb-a9e9-9f21e2145aad',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1022.863276] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.863676] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.863676] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.863676] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.863900] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.863900] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 is going to be updated. [ 1022.896220] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.896452] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.896452] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.896839] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.896839] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.907882] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 in Status: IN_PROGRESS for 2s [ 1022.978868] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.979098] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.979098] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.979440] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.979633] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.980298] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Segment Port c5e7bf05-35e5-4efb-a9e9-9f21e2145aad not found, creating... [ 1022.980298] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.980776] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.980776] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.981657] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.981657] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.981657] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1022.981657] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1022.981825] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1022.982069] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1022.982225] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1022.982367] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Resource: SegmentPort with ID: c5e7bf05-35e5-4efb-a9e9-9f21e2145aad is going to be created. [ 1023.003026] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.003279] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.003431] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.003734] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.004046] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.004318] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "port-c5e7bf05-35e5-4efb-a9e9-9f21e2145aad" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.841213] env[67094]: INFO networking_nsxv3.common.synchronization [req-987c35d2-b3a3-4d42-a3f8-8c2627aab1b8 req-01eee7dd-5262-453d-9d42-8144730bab07 service nova] Enqueued Resource ID: 7e9a1130-f6aa-45df-b627-3bebf6cbd9ff with Priority: HIGHEST for action security_group_rules [ 1023.841417] env[67094]: INFO networking_nsxv3.common.synchronization [req-987c35d2-b3a3-4d42-a3f8-8c2627aab1b8 req-01eee7dd-5262-453d-9d42-8144730bab07 service nova] Enqueued Resource ID: 7e9a1130-f6aa-45df-b627-3bebf6cbd9ff with Priority: HIGHEST for action security_group_members [ 1023.841555] env[67094]: INFO networking_nsxv3.common.synchronization [req-987c35d2-b3a3-4d42-a3f8-8c2627aab1b8 req-01eee7dd-5262-453d-9d42-8144730bab07 service nova] Enqueued Resource ID: c5e7bf05-35e5-4efb-a9e9-9f21e2145aad with Priority: HIGHEST for action port [ 1023.845314] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e9a1130-f6aa-45df-b627-3bebf6cbd9ff with Priority: HIGHEST for action security_group_rules [ 1023.845605] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e9a1130-f6aa-45df-b627-3bebf6cbd9ff with Priority: HIGHEST for action security_group_members [ 1023.845801] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c5e7bf05-35e5-4efb-a9e9-9f21e2145aad with Priority: HIGHEST for action port [ 1023.846976] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e9a1130-f6aa-45df-b627-3bebf6cbd9ff taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.847151] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e9a1130-f6aa-45df-b627-3bebf6cbd9ff" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.847233] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e9a1130-f6aa-45df-b627-3bebf6cbd9ff" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.847444] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e9a1130-f6aa-45df-b627-3bebf6cbd9ff" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.847533] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e9a1130-f6aa-45df-b627-3bebf6cbd9ff',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.850808] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e9a1130-f6aa-45df-b627-3bebf6cbd9ff taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.850808] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e9a1130-f6aa-45df-b627-3bebf6cbd9ff" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.850808] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e9a1130-f6aa-45df-b627-3bebf6cbd9ff" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.850808] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e9a1130-f6aa-45df-b627-3bebf6cbd9ff" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.850808] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.850808] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.850808] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.850808] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.850808] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1023.850808] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e9a1130-f6aa-45df-b627-3bebf6cbd9ff',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1023.851338] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-c5e7bf05-35e5-4efb-a9e9-9f21e2145aad taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1023.851431] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c5e7bf05-35e5-4efb-a9e9-9f21e2145aad" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1023.851496] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c5e7bf05-35e5-4efb-a9e9-9f21e2145aad" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1023.852248] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c5e7bf05-35e5-4efb-a9e9-9f21e2145aad" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1023.853299] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c5e7bf05-35e5-4efb-a9e9-9f21e2145aad',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.356419] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7e9a1130-f6aa-45df-b627-3bebf6cbd9ff',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.356789] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c5e7bf05-35e5-4efb-a9e9-9f21e2145aad with status ACTIVE [ 1024.356789] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.356941] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.356941] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.357529] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.357529] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.357529] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.357771] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.357771] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.357988] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.359436] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.359740] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.359942] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.360164] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.360512] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.360652] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.360864] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c5e7bf05-35e5-4efb-a9e9-9f21e2145aad is going to be updated. [ 1024.364490] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e9a1130-f6aa-45df-b627-3bebf6cbd9ff taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.364649] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e9a1130-f6aa-45df-b627-3bebf6cbd9ff" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.394803] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.395244] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.395244] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.395453] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.396336] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.396336] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c5e7bf05-35e5-4efb-a9e9-9f21e2145aad" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.866398] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7e9a1130-f6aa-45df-b627-3bebf6cbd9ff',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1024.920193] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 in Status: SUCCESS [ 1024.920193] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.920434] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.920589] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.920813] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1024.920974] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1024.921044] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1024.921232] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1024.921489] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.921489] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1024.921489] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.374440] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.374861] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.374861] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.374861] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.374985] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.375101] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e9a1130-f6aa-45df-b627-3bebf6cbd9ff is going to be created. [ 1025.402493] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.402693] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.402693] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.402922] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.403117] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.415289] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e9a1130-f6aa-45df-b627-3bebf6cbd9ff in Status: UNINITIALIZED for 2s [ 1025.427810] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.428388] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.428516] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.428800] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.429026] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.429200] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.429372] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.429798] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.429945] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.430095] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.430307] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.430829] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.430829] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.430829] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.431127] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.431227] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.431302] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.431450] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.431524] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.431602] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.431690] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.552549] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.552784] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.552784] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.554104] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.554673] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.896226] env[67094]: INFO networking_nsxv3.common.synchronization [req-9a4830a7-1e71-4bbc-9279-9a5bb3a1eefe req-939560ba-885a-4fef-bd77-08d3a23c58cd tempest-DeleteServersTestJSON-1237946437 tempest-DeleteServersTestJSON-1237946437-project-member] Enqueued Resource ID: 276c2084-ac8d-475a-af24-a062dc3e17aa with Priority: HIGHEST for action security_group_members [ 1025.896723] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 276c2084-ac8d-475a-af24-a062dc3e17aa with Priority: HIGHEST for action security_group_members [ 1025.897551] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-276c2084-ac8d-475a-af24-a062dc3e17aa taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.897551] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.897551] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.897551] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.897849] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.897849] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.897849] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.898350] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.898350] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.898350] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('276c2084-ac8d-475a-af24-a062dc3e17aa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1025.935249] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6: rpc.has_security_group_logging(os_id): False [ 1025.955427] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.955636] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.955699] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.956786] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.956786] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.956946] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.956946] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.957259] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.957437] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.957539] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.957785] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.957857] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.958139] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.958192] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.958524] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.958524] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1025.958862] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1025.958862] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1025.959016] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1025.959168] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1025.959168] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 is going to be updated. [ 1026.497819] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1026.498480] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.498672] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.498753] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.498989] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.499171] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.500662] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.500777] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.504512] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.504512] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.504512] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.504512] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.504795] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.504795] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.504929] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.505389] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.505389] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 276c2084-ac8d-475a-af24-a062dc3e17aa is going to be updated. [ 1026.532060] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 in Status: IN_PROGRESS for 2s [ 1026.554558] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.554558] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.554558] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.554558] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.554558] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1026.566412] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 276c2084-ac8d-475a-af24-a062dc3e17aa in Status: IN_PROGRESS for 2s [ 1026.647133] env[67094]: INFO networking_nsxv3.common.synchronization [None req-f0cb5d15-74e5-4f17-93cb-0e5a412d9d91 None None] Enqueued Resource ID: fd3322e2-962e-4663-843e-b1cce4209b1b with Priority: HIGHEST for action port [ 1026.648837] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd3322e2-962e-4663-843e-b1cce4209b1b with Priority: HIGHEST for action port [ 1026.649384] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-fd3322e2-962e-4663-843e-b1cce4209b1b taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1026.649798] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fd3322e2-962e-4663-843e-b1cce4209b1b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1026.649798] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fd3322e2-962e-4663-843e-b1cce4209b1b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1026.650213] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fd3322e2-962e-4663-843e-b1cce4209b1b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1026.650297] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd3322e2-962e-4663-843e-b1cce4209b1b',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.011763] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.154470] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port fd3322e2-962e-4663-843e-b1cce4209b1b [ 1027.154739] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.155125] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.155215] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.155432] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.155661] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.155661] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:fd3322e2-962e-4663-843e-b1cce4209b1b already deleted. [ 1027.155847] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fd3322e2-962e-4663-843e-b1cce4209b1b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.427140] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e9a1130-f6aa-45df-b627-3bebf6cbd9ff in Status: SUCCESS [ 1027.427606] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e9a1130-f6aa-45df-b627-3bebf6cbd9ff" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.427606] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e9a1130-f6aa-45df-b627-3bebf6cbd9ff" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.427838] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e9a1130-f6aa-45df-b627-3bebf6cbd9ff" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.428068] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1027.428216] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1027.428282] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1027.428458] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1027.428578] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.428649] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e9a1130-f6aa-45df-b627-3bebf6cbd9ff" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1027.428752] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7e9a1130-f6aa-45df-b627-3bebf6cbd9ff',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1027.513873] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1027.513873] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1027.931774] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7e9a1130-f6aa-45df-b627-3bebf6cbd9ff',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1028.438090] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7e9a1130-f6aa-45df-b627-3bebf6cbd9ff: rpc.has_security_group_logging(os_id): False [ 1028.459322] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.460174] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.460284] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.460568] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.460701] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.460984] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.461105] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.461164] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.461323] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.462107] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.462107] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e9a1130-f6aa-45df-b627-3bebf6cbd9ff is going to be created. [ 1028.537529] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.537877] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.537877] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.538147] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.554994] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1028.556090] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.557433] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1028.565062] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.565286] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.565362] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.565583] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.565779] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.588100] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e9a1130-f6aa-45df-b627-3bebf6cbd9ff in Status: IN_PROGRESS for 2s [ 1028.590747] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 in Status: SUCCESS [ 1028.590747] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.591194] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 276c2084-ac8d-475a-af24-a062dc3e17aa in Status: SUCCESS [ 1028.592287] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 276c2084-ac8d-475a-af24-a062dc3e17aa deletion is rescheduled due to dependency. [ 1028.592287] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.623384] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.623710] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.623710] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.623962] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.633834] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.635530] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1028.635530] env[67094]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=67094) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1028.635530] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1028.726084] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.727075] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.727075] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.727075] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.729770] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.730441] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1028.850720] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1028.851092] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1028.851092] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1028.851311] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1028.851608] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1028.851821] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1029.026391] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.026665] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.026665] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.027065] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.028036] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.028036] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:52. [ 1029.028036] env[67094]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'a9f3a2fb-a15a-4ea6-a2e4-0a89b6b14559', '84918628-8f8e-4d25-9c0f-17cccb58ebfa', '0ee9080c-8cce-48e3-86d7-285fa4431dd0', '6b8aa78a-ad3e-4d9d-94d1-2156bff23176', '280210af-8e3d-42c9-8854-42bd856b9dbe', '00b541f3-9964-40ec-91e3-e2aa8166f007', 'fa13d7cb-fe19-4ac5-ab31-738acdf72313', '529c6563-9354-49e2-8282-acd28e0b0ef7', '6745d4e2-6069-4132-80d9-76cf2245b017', '9acaf46f-6800-4e8d-bec0-432525de6a87', '763488f4-7445-4094-9732-5af84c8ba064', '5d6b6e19-f017-4eac-b0ac-ed1b17230d12', '79476966-6948-4fb4-811c-c9f8cee63da2', '4338a2b6-fa27-47ec-8f93-f4223c009203', 'f7861002-4b91-437c-8519-9140d1a3bd82', 'b61bfa2d-4c26-4a49-a153-4a8fb6153ccd', '0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9', '087ace1a-6d14-459c-b6b4-b5fb31f2020d', '7e9a1130-f6aa-45df-b627-3bebf6cbd9ff', 'ae59884c-acbd-4c88-8cdb-fd8d14c95621', '34b6178d-c850-4655-81a1-f452d6a6f576', '2bc6c42e-23db-4008-8db7-e57d76593898', '018c19d8-0b0e-41bd-8f01-0c9c58710c57', 'c49f7fe8-62a6-4df5-90fb-465116c226a3', 'a685dbf9-8823-4364-9677-e8aff5bd2a59', 'a300461d-04cc-44a3-bc50-afbfc1076857', '4ec74abc-987a-4435-8c42-e7e606ef3293', '71aa8195-5281-4a1c-b9a7-3d40e851f47e', 'eb77eddf-2e1d-485c-bfe8-67d4c174dc73', 'f71d6693-6145-4241-b055-f03e34f73c7f', '1c0d7199-02e7-494e-9784-a23947a72cd2', '005d1062-21f3-48fc-b7a0-06c9f0fc7843', '34103f55-eb7e-4602-9672-09596df7eaa4', '882c69d3-9554-45c6-97a1-55fb0f065040', '276c2084-ac8d-475a-af24-a062dc3e17aa', '3ece2d85-d26d-4c59-ae47-b9a59cc4de8f', '00f05527-967f-4b60-a2ba-dd3e2d9bad21', '62f0dd40-a793-48dd-b62a-abaa0eeebd45', 'fbf0de02-2c4b-4156-ae88-4a3e624f550d', '4e31526a-4068-4c26-bce5-72c9c1c3964e', '0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6', 'cb367675-42aa-4b50-8812-8a73fdef747d', '7ec28241-1cbc-4bfa-acfa-d9a84a1a6dae', '0c6a3072-604c-444a-b4d4-9ed06e060bef', '0d0028b4-3629-4ade-8832-b0fbfb48d140', '75d792df-97d6-4e1a-bf50-631a4a868869', 'c0881101-1be1-4dbf-ac18-2d54a689202c', '52851555-797a-47ba-b408-d4557f3f4ec2', '04d0f31c-3c4e-40ac-a405-c43379f06123', '0f2ac94a-4beb-4e79-8490-47989224cf9f', '0e314269-1025-4c1f-b42e-8acab2134cbb', '60943622-73b5-4dda-ad21-63bf08db617e'} {{(pid=67094) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1029.028305] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1029.055851] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.056076] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.056194] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.056409] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.056512] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.056639] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1029.056962] env[67094]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=67094) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1029.056962] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1029.180256] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.180256] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.180256] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.180256] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.181084] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.181542] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1029.181542] env[67094]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=67094) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1029.181542] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1029.181828] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1029.181828] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/52 resources of Type:Security Group Rules [ 1029.181828] env[67094]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a9f3a2fb-a15a-4ea6-a2e4-0a89b6b14559 with Priority: HIGH for action security_group_rules [ 1029.181828] env[67094]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa with Priority: HIGH for action security_group_rules [ 1029.181963] env[67094]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0ee9080c-8cce-48e3-86d7-285fa4431dd0 with Priority: HIGH for action security_group_rules [ 1029.181963] env[67094]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6b8aa78a-ad3e-4d9d-94d1-2156bff23176 with Priority: HIGH for action security_group_rules [ 1029.182165] env[67094]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 280210af-8e3d-42c9-8854-42bd856b9dbe with Priority: HIGH for action security_group_rules [ 1029.182165] env[67094]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 00b541f3-9964-40ec-91e3-e2aa8166f007 with Priority: HIGH for action security_group_rules [ 1029.182165] env[67094]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: fa13d7cb-fe19-4ac5-ab31-738acdf72313 with Priority: HIGH for action security_group_rules [ 1029.182165] env[67094]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 529c6563-9354-49e2-8282-acd28e0b0ef7 with Priority: HIGH for action security_group_rules [ 1029.182353] env[67094]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6745d4e2-6069-4132-80d9-76cf2245b017 with Priority: HIGH for action security_group_rules [ 1029.182353] env[67094]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 9acaf46f-6800-4e8d-bec0-432525de6a87 with Priority: HIGH for action security_group_rules [ 1029.182353] env[67094]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 763488f4-7445-4094-9732-5af84c8ba064 with Priority: HIGH for action security_group_rules [ 1029.182513] env[67094]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5d6b6e19-f017-4eac-b0ac-ed1b17230d12 with Priority: HIGH for action security_group_rules [ 1029.182513] env[67094]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 79476966-6948-4fb4-811c-c9f8cee63da2 with Priority: HIGH for action security_group_rules [ 1029.182513] env[67094]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4338a2b6-fa27-47ec-8f93-f4223c009203 with Priority: HIGH for action security_group_rules [ 1029.182651] env[67094]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: f7861002-4b91-437c-8519-9140d1a3bd82 with Priority: HIGH for action security_group_rules [ 1029.182651] env[67094]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b61bfa2d-4c26-4a49-a153-4a8fb6153ccd with Priority: HIGH for action security_group_rules [ 1029.182751] env[67094]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 with Priority: HIGH for action security_group_rules [ 1029.182751] env[67094]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 087ace1a-6d14-459c-b6b4-b5fb31f2020d with Priority: HIGH for action security_group_rules [ 1029.182839] env[67094]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7e9a1130-f6aa-45df-b627-3bebf6cbd9ff with Priority: HIGH for action security_group_rules [ 1029.182901] env[67094]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: ae59884c-acbd-4c88-8cdb-fd8d14c95621 with Priority: HIGH for action security_group_rules [ 1029.183100] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.439740] env[67094]: INFO networking_nsxv3.common.synchronization [None req-f842827e-292e-4260-bce4-b2872f1e6f6c None None] Enqueued Resource ID: e71d368e-4eeb-438f-899b-8eab0b4c6146 with Priority: HIGHEST for action port [ 1029.440287] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e71d368e-4eeb-438f-899b-8eab0b4c6146 with Priority: HIGHEST for action port [ 1029.442063] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a9f3a2fb-a15a-4ea6-a2e4-0a89b6b14559 with Priority: HIGH for action security_group_rules [ 1029.442063] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0ee9080c-8cce-48e3-86d7-285fa4431dd0 with Priority: HIGH for action security_group_rules [ 1029.442265] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fa13d7cb-fe19-4ac5-ab31-738acdf72313 with Priority: HIGH for action security_group_rules [ 1029.442325] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: f7861002-4b91-437c-8519-9140d1a3bd82 with Priority: HIGH for action security_group_rules [ 1029.442457] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ae59884c-acbd-4c88-8cdb-fd8d14c95621 with Priority: HIGH for action security_group_rules [ 1029.442504] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e9a1130-f6aa-45df-b627-3bebf6cbd9ff with Priority: HIGH for action security_group_rules [ 1029.442592] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 087ace1a-6d14-459c-b6b4-b5fb31f2020d with Priority: HIGH for action security_group_rules [ 1029.443467] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 with Priority: HIGH for action security_group_rules [ 1029.443467] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4338a2b6-fa27-47ec-8f93-f4223c009203 with Priority: HIGH for action security_group_rules [ 1029.443467] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b61bfa2d-4c26-4a49-a153-4a8fb6153ccd with Priority: HIGH for action security_group_rules [ 1029.443467] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79476966-6948-4fb4-811c-c9f8cee63da2 with Priority: HIGH for action security_group_rules [ 1029.443467] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d6b6e19-f017-4eac-b0ac-ed1b17230d12 with Priority: HIGH for action security_group_rules [ 1029.443467] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 763488f4-7445-4094-9732-5af84c8ba064 with Priority: HIGH for action security_group_rules [ 1029.443467] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9acaf46f-6800-4e8d-bec0-432525de6a87 with Priority: HIGH for action security_group_rules [ 1029.443467] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6745d4e2-6069-4132-80d9-76cf2245b017 with Priority: HIGH for action security_group_rules [ 1029.443467] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 00b541f3-9964-40ec-91e3-e2aa8166f007 with Priority: HIGH for action security_group_rules [ 1029.443905] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 529c6563-9354-49e2-8282-acd28e0b0ef7 with Priority: HIGH for action security_group_rules [ 1029.443905] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 280210af-8e3d-42c9-8854-42bd856b9dbe with Priority: HIGH for action security_group_rules [ 1029.443905] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa with Priority: HIGH for action security_group_rules [ 1029.443905] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6b8aa78a-ad3e-4d9d-94d1-2156bff23176 with Priority: HIGH for action security_group_rules [ 1029.444123] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-e71d368e-4eeb-438f-899b-8eab0b4c6146 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.444259] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e71d368e-4eeb-438f-899b-8eab0b4c6146" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.444326] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e71d368e-4eeb-438f-899b-8eab0b4c6146" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.444619] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e71d368e-4eeb-438f-899b-8eab0b4c6146" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.444715] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e71d368e-4eeb-438f-899b-8eab0b4c6146',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.448690] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a9f3a2fb-a15a-4ea6-a2e4-0a89b6b14559 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.448859] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a9f3a2fb-a15a-4ea6-a2e4-0a89b6b14559" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.448900] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a9f3a2fb-a15a-4ea6-a2e4-0a89b6b14559" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.449111] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a9f3a2fb-a15a-4ea6-a2e4-0a89b6b14559" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.450058] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a9f3a2fb-a15a-4ea6-a2e4-0a89b6b14559',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.450415] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0ee9080c-8cce-48e3-86d7-285fa4431dd0 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.450542] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.450606] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.450821] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.450898] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0ee9080c-8cce-48e3-86d7-285fa4431dd0',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.451765] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fa13d7cb-fe19-4ac5-ab31-738acdf72313 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.451885] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fa13d7cb-fe19-4ac5-ab31-738acdf72313" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.451937] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fa13d7cb-fe19-4ac5-ab31-738acdf72313" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.453027] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fa13d7cb-fe19-4ac5-ab31-738acdf72313" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.453027] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fa13d7cb-fe19-4ac5-ab31-738acdf72313',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.453027] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-f7861002-4b91-437c-8519-9140d1a3bd82 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.453197] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.453282] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.453460] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.453534] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('f7861002-4b91-437c-8519-9140d1a3bd82',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.454335] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-ae59884c-acbd-4c88-8cdb-fd8d14c95621 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.454794] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-ae59884c-acbd-4c88-8cdb-fd8d14c95621" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.455127] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-ae59884c-acbd-4c88-8cdb-fd8d14c95621" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.455326] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-ae59884c-acbd-4c88-8cdb-fd8d14c95621" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.455410] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('ae59884c-acbd-4c88-8cdb-fd8d14c95621',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.457594] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e9a1130-f6aa-45df-b627-3bebf6cbd9ff taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.457594] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e9a1130-f6aa-45df-b627-3bebf6cbd9ff" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.457594] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-087ace1a-6d14-459c-b6b4-b5fb31f2020d taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.457594] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-087ace1a-6d14-459c-b6b4-b5fb31f2020d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.457594] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-087ace1a-6d14-459c-b6b4-b5fb31f2020d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.457594] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-087ace1a-6d14-459c-b6b4-b5fb31f2020d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.457594] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('087ace1a-6d14-459c-b6b4-b5fb31f2020d',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.458040] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.458097] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.458191] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.458307] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.458376] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.459180] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4338a2b6-fa27-47ec-8f93-f4223c009203 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.459311] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4338a2b6-fa27-47ec-8f93-f4223c009203" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.459366] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4338a2b6-fa27-47ec-8f93-f4223c009203" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.459511] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4338a2b6-fa27-47ec-8f93-f4223c009203" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.459607] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4338a2b6-fa27-47ec-8f93-f4223c009203',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.460399] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b61bfa2d-4c26-4a49-a153-4a8fb6153ccd taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.460512] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b61bfa2d-4c26-4a49-a153-4a8fb6153ccd" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.460564] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b61bfa2d-4c26-4a49-a153-4a8fb6153ccd" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.460735] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b61bfa2d-4c26-4a49-a153-4a8fb6153ccd" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.460805] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b61bfa2d-4c26-4a49-a153-4a8fb6153ccd',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.461710] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-79476966-6948-4fb4-811c-c9f8cee63da2 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.461903] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.461903] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.463086] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.463086] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('79476966-6948-4fb4-811c-c9f8cee63da2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.463086] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5d6b6e19-f017-4eac-b0ac-ed1b17230d12 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.463086] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5d6b6e19-f017-4eac-b0ac-ed1b17230d12" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.463361] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5d6b6e19-f017-4eac-b0ac-ed1b17230d12" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.463361] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5d6b6e19-f017-4eac-b0ac-ed1b17230d12" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.463361] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5d6b6e19-f017-4eac-b0ac-ed1b17230d12',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.464163] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-763488f4-7445-4094-9732-5af84c8ba064 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.464952] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-763488f4-7445-4094-9732-5af84c8ba064" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.464952] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-763488f4-7445-4094-9732-5af84c8ba064" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.464952] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-763488f4-7445-4094-9732-5af84c8ba064" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.464952] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('763488f4-7445-4094-9732-5af84c8ba064',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.465411] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-9acaf46f-6800-4e8d-bec0-432525de6a87 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.465411] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-9acaf46f-6800-4e8d-bec0-432525de6a87" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.465534] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-9acaf46f-6800-4e8d-bec0-432525de6a87" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.465638] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-9acaf46f-6800-4e8d-bec0-432525de6a87" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.466000] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('9acaf46f-6800-4e8d-bec0-432525de6a87',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.466845] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6745d4e2-6069-4132-80d9-76cf2245b017 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.466845] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6745d4e2-6069-4132-80d9-76cf2245b017" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.466845] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6745d4e2-6069-4132-80d9-76cf2245b017" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.467089] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6745d4e2-6069-4132-80d9-76cf2245b017" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.467089] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6745d4e2-6069-4132-80d9-76cf2245b017',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.467933] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-00b541f3-9964-40ec-91e3-e2aa8166f007 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.468134] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-00b541f3-9964-40ec-91e3-e2aa8166f007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.468134] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-00b541f3-9964-40ec-91e3-e2aa8166f007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.469165] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-00b541f3-9964-40ec-91e3-e2aa8166f007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.469165] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('00b541f3-9964-40ec-91e3-e2aa8166f007',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.469165] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-529c6563-9354-49e2-8282-acd28e0b0ef7 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.469165] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-529c6563-9354-49e2-8282-acd28e0b0ef7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.469397] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-529c6563-9354-49e2-8282-acd28e0b0ef7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.469397] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-529c6563-9354-49e2-8282-acd28e0b0ef7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.469541] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('529c6563-9354-49e2-8282-acd28e0b0ef7',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.470947] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-280210af-8e3d-42c9-8854-42bd856b9dbe taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.470947] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.470947] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.470947] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.470947] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('280210af-8e3d-42c9-8854-42bd856b9dbe',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.471770] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-84918628-8f8e-4d25-9c0f-17cccb58ebfa taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.471915] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.471915] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.472114] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.472190] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('84918628-8f8e-4d25-9c0f-17cccb58ebfa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.473883] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6b8aa78a-ad3e-4d9d-94d1-2156bff23176 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.473883] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6b8aa78a-ad3e-4d9d-94d1-2156bff23176" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.473883] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6b8aa78a-ad3e-4d9d-94d1-2156bff23176" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.473883] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6b8aa78a-ad3e-4d9d-94d1-2156bff23176" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.473883] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6b8aa78a-ad3e-4d9d-94d1-2156bff23176',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.511743] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.512030] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.512030] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.512677] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.552650] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.552650] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a9f3a2fb-a15a-4ea6-a2e4-0a89b6b14559 is going to be deleted. [ 1029.617246] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.618694] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.618694] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.618694] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.618694] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.618694] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a9f3a2fb-a15a-4ea6-a2e4-0a89b6b14559" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.818471] env[67094]: INFO networking_nsxv3.common.synchronization [None req-bd65609c-e547-4a59-88b8-94b5b7006292 tempest-AttachInterfacesTestJSON-1117082489 tempest-AttachInterfacesTestJSON-1117082489-project-member] Enqueued Resource ID: 8c8bcd5f-7602-4632-8046-daa41c621837 with Priority: HIGHEST for action security_group_rules [ 1029.818471] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c8bcd5f-7602-4632-8046-daa41c621837 with Priority: HIGHEST for action security_group_rules [ 1029.818858] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c8bcd5f-7602-4632-8046-daa41c621837 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.818981] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c8bcd5f-7602-4632-8046-daa41c621837" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.819069] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c8bcd5f-7602-4632-8046-daa41c621837" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.822679] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c8bcd5f-7602-4632-8046-daa41c621837" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.822679] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c8bcd5f-7602-4632-8046-daa41c621837',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.927030] env[67094]: INFO networking_nsxv3.common.synchronization [None req-7db1ed65-f856-4a25-a1b5-5e3f1c98e450 tempest-AttachInterfacesTestJSON-1117082489 tempest-AttachInterfacesTestJSON-1117082489-project-member] Enqueued Resource ID: 8c8bcd5f-7602-4632-8046-daa41c621837 with Priority: HIGHEST for action security_group_rules [ 1029.927409] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c8bcd5f-7602-4632-8046-daa41c621837 with Priority: HIGHEST for action security_group_rules [ 1029.927742] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c8bcd5f-7602-4632-8046-daa41c621837 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.927844] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c8bcd5f-7602-4632-8046-daa41c621837" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.976673] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-b61bfa2d-4c26-4a49-a153-4a8fb6153ccd taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.978259] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b61bfa2d-4c26-4a49-a153-4a8fb6153ccd" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.978259] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b61bfa2d-4c26-4a49-a153-4a8fb6153ccd" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.978259] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b61bfa2d-4c26-4a49-a153-4a8fb6153ccd" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.978259] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.978259] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.978259] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.978259] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.978259] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.978259] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b61bfa2d-4c26-4a49-a153-4a8fb6153ccd" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.978259] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b61bfa2d-4c26-4a49-a153-4a8fb6153ccd',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.979606] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port e71d368e-4eeb-438f-899b-8eab0b4c6146 [ 1029.979606] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.979606] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.979606] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.981118] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.981118] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.981118] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:e71d368e-4eeb-438f-899b-8eab0b4c6146 already deleted. [ 1029.981118] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e71d368e-4eeb-438f-899b-8eab0b4c6146" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.981525] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-280210af-8e3d-42c9-8854-42bd856b9dbe taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.981525] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.981525] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.981666] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.981702] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.981793] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.981888] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.982024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.982494] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.982494] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.982494] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('280210af-8e3d-42c9-8854-42bd856b9dbe',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.983920] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d6b6e19-f017-4eac-b0ac-ed1b17230d12 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.984085] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d6b6e19-f017-4eac-b0ac-ed1b17230d12" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.984085] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d6b6e19-f017-4eac-b0ac-ed1b17230d12" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.984252] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d6b6e19-f017-4eac-b0ac-ed1b17230d12" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.984381] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.984467] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.984528] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.985231] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.985231] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.985231] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d6b6e19-f017-4eac-b0ac-ed1b17230d12" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.985231] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('5d6b6e19-f017-4eac-b0ac-ed1b17230d12',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.989049] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-529c6563-9354-49e2-8282-acd28e0b0ef7 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.989208] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-529c6563-9354-49e2-8282-acd28e0b0ef7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.989274] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-529c6563-9354-49e2-8282-acd28e0b0ef7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.989390] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-529c6563-9354-49e2-8282-acd28e0b0ef7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.989534] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.989765] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.989765] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.989945] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.989945] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.990031] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-529c6563-9354-49e2-8282-acd28e0b0ef7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.990747] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('529c6563-9354-49e2-8282-acd28e0b0ef7',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1029.992294] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.992896] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.992896] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.992896] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.992896] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1029.992896] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1029.992896] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1029.993233] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1029.993233] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.993233] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1029.993422] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.048687] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.048836] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.048919] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.049216] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.052036] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.052246] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.054223] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.054430] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.055408] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.056690] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.056690] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.056690] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.057510] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.058707] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.058707] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.058707] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.061217] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.061481] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.066933] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.068166] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.074377] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.074586] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.079523] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.079709] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.080959] env[67094]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1030.081813] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.081813] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.094393] env[67094]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1030.094972] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.095149] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 087ace1a-6d14-459c-b6b4-b5fb31f2020d is going to be deleted. [ 1030.096135] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.096360] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.105915] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.106177] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.314162] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.314162] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.314162] env[67094]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1030.315149] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.315149] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 9acaf46f-6800-4e8d-bec0-432525de6a87 is going to be deleted. [ 1030.319544] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.319544] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.367973] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.368146] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.382571] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.382720] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4338a2b6-fa27-47ec-8f93-f4223c009203 is going to be deleted. [ 1030.383863] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.384094] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.427344] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.427504] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 84918628-8f8e-4d25-9c0f-17cccb58ebfa is going to be deleted. [ 1030.428455] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.428729] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.451720] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.451835] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.460215] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.460872] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0ee9080c-8cce-48e3-86d7-285fa4431dd0 is going to be deleted. [ 1030.462332] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.463292] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.468899] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.469092] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.481770] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b61bfa2d-4c26-4a49-a153-4a8fb6153ccd',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.490896] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.491214] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fa13d7cb-fe19-4ac5-ab31-738acdf72313 is going to be deleted. [ 1030.492390] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.492618] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.499723] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-280210af-8e3d-42c9-8854-42bd856b9dbe taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.500153] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.500374] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.500875] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.501096] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.501300] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.501441] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.501912] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.502359] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.502359] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.502911] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-280210af-8e3d-42c9-8854-42bd856b9dbe taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.502911] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.503148] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.503584] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.503985] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.504227] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.504393] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.504769] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.504918] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.505185] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.505381] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('280210af-8e3d-42c9-8854-42bd856b9dbe',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.506738] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.510494] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('5d6b6e19-f017-4eac-b0ac-ed1b17230d12',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.511230] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('529c6563-9354-49e2-8282-acd28e0b0ef7',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.527727] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.528797] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.594142] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.594410] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6745d4e2-6069-4132-80d9-76cf2245b017 is going to be deleted. [ 1030.595759] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.595759] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.644356] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.644356] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.672387] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.672387] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: ae59884c-acbd-4c88-8cdb-fd8d14c95621 is going to be deleted. [ 1030.672387] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.672951] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.674907] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.675345] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.710506] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e9a1130-f6aa-45df-b627-3bebf6cbd9ff in Status: SUCCESS [ 1030.711312] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e9a1130-f6aa-45df-b627-3bebf6cbd9ff" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.711819] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e9a1130-f6aa-45df-b627-3bebf6cbd9ff" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.712345] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e9a1130-f6aa-45df-b627-3bebf6cbd9ff" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.712600] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e9a1130-f6aa-45df-b627-3bebf6cbd9ff',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.734069] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.734069] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 763488f4-7445-4094-9732-5af84c8ba064 is going to be deleted. [ 1030.734069] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.734069] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.804095] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.804095] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: f7861002-4b91-437c-8519-9140d1a3bd82 is going to be deleted. [ 1030.804095] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.804095] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.806017] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.806193] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.902398] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.902577] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 79476966-6948-4fb4-811c-c9f8cee63da2 is going to be deleted. [ 1030.906072] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.910034] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.910034] env[67094]: INFO networking_nsxv3.common.synchronization [req-f5981efc-cc5f-43d5-8622-fa117ec29de2 req-5117860a-e31a-4989-be92-59fa714ac1ea tempest-ServersV294TestFqdnHostnames-2045593341 tempest-ServersV294TestFqdnHostnames-2045593341-project-member] Enqueued Resource ID: 3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56 with Priority: HIGHEST for action security_group_members [ 1030.911574] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.911786] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.913057] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56 with Priority: HIGHEST for action security_group_members [ 1030.914139] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.914340] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.914442] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.914855] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.915099] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1030.915241] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1030.915306] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1030.915460] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1030.915634] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1030.915698] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1030.984572] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b61bfa2d-4c26-4a49-a153-4a8fb6153ccd: rpc.has_security_group_logging(os_id): False [ 1031.000060] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.000343] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6b8aa78a-ad3e-4d9d-94d1-2156bff23176 is going to be deleted. [ 1031.001905] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.002438] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.009895] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9: rpc.has_security_group_logging(os_id): False [ 1031.012024] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 280210af-8e3d-42c9-8854-42bd856b9dbe: rpc.has_security_group_logging(os_id): False [ 1031.015024] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.015317] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.015750] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 5d6b6e19-f017-4eac-b0ac-ed1b17230d12: rpc.has_security_group_logging(os_id): False [ 1031.017485] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 529c6563-9354-49e2-8282-acd28e0b0ef7: rpc.has_security_group_logging(os_id): False [ 1031.049735] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.050013] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.068791] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.069045] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.070219] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.070436] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.071490] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.071764] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.074086] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.074390] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.105747] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.106027] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.109515] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.109706] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 00b541f3-9964-40ec-91e3-e2aa8166f007 is going to be deleted. [ 1031.110956] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.111245] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.111401] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.111597] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-087ace1a-6d14-459c-b6b4-b5fb31f2020d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.111808] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.112047] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.112241] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.112461] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c8bcd5f-7602-4632-8046-daa41c621837 already deleted. [ 1031.112584] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c8bcd5f-7602-4632-8046-daa41c621837" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.113493] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.113815] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.113911] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.114134] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-9acaf46f-6800-4e8d-bec0-432525de6a87" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.114512] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c8bcd5f-7602-4632-8046-daa41c621837" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.114998] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c8bcd5f-7602-4632-8046-daa41c621837" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.115169] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c8bcd5f-7602-4632-8046-daa41c621837',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.118138] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.121017] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.124135] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.124467] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4338a2b6-fa27-47ec-8f93-f4223c009203" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.124808] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.127834] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.127834] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.128272] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-84918628-8f8e-4d25-9c0f-17cccb58ebfa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.128272] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.128559] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.128622] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.128791] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0ee9080c-8cce-48e3-86d7-285fa4431dd0" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.129843] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.129843] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.129843] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.129843] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fa13d7cb-fe19-4ac5-ab31-738acdf72313" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.129843] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.130034] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.130176] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.130282] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6745d4e2-6069-4132-80d9-76cf2245b017" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.130478] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.130793] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.130841] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.130995] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-ae59884c-acbd-4c88-8cdb-fd8d14c95621" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.131544] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.131544] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.131544] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.131742] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-763488f4-7445-4094-9732-5af84c8ba064" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.131742] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.132165] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.132165] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.132165] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-f7861002-4b91-437c-8519-9140d1a3bd82" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.132550] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.136024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.140602] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.140788] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.195614] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.196099] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.196242] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.196242] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.196399] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.196472] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.196563] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5d6b6e19-f017-4eac-b0ac-ed1b17230d12 is going to be updated. [ 1031.197735] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.202156] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.219255] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e9a1130-f6aa-45df-b627-3bebf6cbd9ff taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.219458] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e9a1130-f6aa-45df-b627-3bebf6cbd9ff" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.219532] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e9a1130-f6aa-45df-b627-3bebf6cbd9ff" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.219786] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e9a1130-f6aa-45df-b627-3bebf6cbd9ff" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.220048] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.220243] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.220344] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.221022] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.221022] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.221022] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e9a1130-f6aa-45df-b627-3bebf6cbd9ff" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.221022] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7e9a1130-f6aa-45df-b627-3bebf6cbd9ff',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.223714] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.223835] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.246075] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.246477] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.246590] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.246662] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.246973] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.246973] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.247215] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b61bfa2d-4c26-4a49-a153-4a8fb6153ccd is going to be updated. [ 1031.249470] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.249470] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.289814] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.290111] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.320847] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.321124] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.376135] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.376208] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.376316] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.376384] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.376647] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.376767] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.376875] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 is going to be updated. [ 1031.379234] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.379930] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.380682] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.380682] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-79476966-6948-4fb4-811c-c9f8cee63da2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.380682] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.381492] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.418320] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.418628] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.480251] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.480705] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.480908] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.480984] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.481232] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.481319] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.481783] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.481942] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.482064] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.482310] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.482484] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.482708] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.482825] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.482911] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.483133] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.483247] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.483370] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 280210af-8e3d-42c9-8854-42bd856b9dbe is going to be updated. [ 1031.484591] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.485033] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.522795] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock network-353 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.523074] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "network-353" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.524548] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "network-353" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.524548] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "network-353" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.524548] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.524548] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.524548] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.525031] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.525031] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.525031] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1031.525130] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1031.525311] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1031.525311] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1031.525431] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1031.526490] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1031.526490] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1031.531986] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.531986] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.531986] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.531986] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.531986] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.531986] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.531986] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 529c6563-9354-49e2-8282-acd28e0b0ef7 is going to be updated. [ 1031.532470] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.532701] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.533582] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.534858] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.535714] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.535714] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.535871] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6b8aa78a-ad3e-4d9d-94d1-2156bff23176" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.536436] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.536436] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.536599] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.536863] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.537250] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.537423] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.537675] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.537785] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.537893] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56 already deleted. [ 1031.537997] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.539046] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.539046] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.539046] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.539046] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-00b541f3-9964-40ec-91e3-e2aa8166f007" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.598738] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.599399] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.599399] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.599485] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.600710] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.604980] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1031.605301] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Cache value generated in 0.079 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1031.605460] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1031.605641] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "network-353" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.606016] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock port-79a575bb-d65c-49b0-a0a6-6bea2fc25144 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.606218] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "port-79a575bb-d65c-49b0-a0a6-6bea2fc25144" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.606337] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "port-79a575bb-d65c-49b0-a0a6-6bea2fc25144" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.606669] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "port-79a575bb-d65c-49b0-a0a6-6bea2fc25144" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.606880] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79a575bb-d65c-49b0-a0a6-6bea2fc25144',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.633793] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.633793] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.634181] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.634257] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.634424] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.640246] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d6b6e19-f017-4eac-b0ac-ed1b17230d12 in Status: IN_PROGRESS for 2s [ 1031.642395] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b61bfa2d-4c26-4a49-a153-4a8fb6153ccd in Status: IN_PROGRESS for 2s [ 1031.658779] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 in Status: IN_PROGRESS for 2s [ 1031.683148] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.683355] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.683355] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.683540] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.683633] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.683738] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c8bcd5f-7602-4632-8046-daa41c621837 already deleted. [ 1031.683848] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c8bcd5f-7602-4632-8046-daa41c621837" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.710504] env[67094]: INFO networking_nsxv3.common.synchronization [req-910850dc-7974-45b0-b4fa-9e293df06ae4 req-d3c5dab6-4cc1-4a80-b5ae-f7eef39f0e7a tempest-ServersTestJSON-1070791530 tempest-ServersTestJSON-1070791530-project-member] Enqueued Resource ID: c0881101-1be1-4dbf-ac18-2d54a689202c with Priority: HIGHEST for action security_group_members [ 1031.711148] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0881101-1be1-4dbf-ac18-2d54a689202c with Priority: HIGHEST for action security_group_members [ 1031.711501] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0881101-1be1-4dbf-ac18-2d54a689202c taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.711642] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.711745] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.712028] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.712202] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.712318] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.712383] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.712550] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.712653] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.712754] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.725091] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7e9a1130-f6aa-45df-b627-3bebf6cbd9ff',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1031.735223] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.735708] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.735794] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.736016] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.736177] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.749541] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1031.750378] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1031.750502] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1031.750780] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1031.750980] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1031.763125] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 280210af-8e3d-42c9-8854-42bd856b9dbe in Status: IN_PROGRESS for 2s [ 1031.774459] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 529c6563-9354-49e2-8282-acd28e0b0ef7 in Status: IN_PROGRESS for 2s [ 1032.109456] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.109823] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.110110] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.110679] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.111043] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.111408] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Segment Port 79a575bb-d65c-49b0-a0a6-6bea2fc25144 not found, creating... [ 1032.111849] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.112081] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.112210] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.112464] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.112629] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.112936] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.113109] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.113249] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.113496] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.113625] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.113791] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Resource: SegmentPort with ID: 79a575bb-d65c-49b0-a0a6-6bea2fc25144 is going to be created. [ 1032.137206] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.137482] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.137617] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.137937] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.138202] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.138421] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "port-79a575bb-d65c-49b0-a0a6-6bea2fc25144" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.216327] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.227277] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7e9a1130-f6aa-45df-b627-3bebf6cbd9ff: rpc.has_security_group_logging(os_id): False [ 1032.246314] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.246513] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.246513] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.249111] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.280440] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.281035] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.281035] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.281035] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.281277] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.281388] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.281478] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e9a1130-f6aa-45df-b627-3bebf6cbd9ff is going to be updated. [ 1032.381924] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.382526] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.386276] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.386276] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.386276] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.410097] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e9a1130-f6aa-45df-b627-3bebf6cbd9ff in Status: IN_PROGRESS for 2s [ 1032.719206] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.773209] env[67094]: INFO networking_nsxv3.common.synchronization [req-67ef4d25-d3d5-40e6-a561-9e84fc2f1c87 req-c3f8618d-5c29-4b02-af6d-bde0d6b05b3d tempest-InstanceActionsTestJSON-1306434726 tempest-InstanceActionsTestJSON-1306434726-project-member] Enqueued Resource ID: 04d0f31c-3c4e-40ac-a405-c43379f06123 with Priority: HIGHEST for action security_group_members [ 1032.773209] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 04d0f31c-3c4e-40ac-a405-c43379f06123 with Priority: HIGHEST for action security_group_members [ 1032.773209] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-04d0f31c-3c4e-40ac-a405-c43379f06123 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.773209] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-04d0f31c-3c4e-40ac-a405-c43379f06123" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.774754] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-04d0f31c-3c4e-40ac-a405-c43379f06123" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.775069] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-04d0f31c-3c4e-40ac-a405-c43379f06123" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.776032] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.776032] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.776032] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.776032] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.776032] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.776032] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('04d0f31c-3c4e-40ac-a405-c43379f06123',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.792369] env[67094]: INFO networking_nsxv3.common.synchronization [req-f5981efc-cc5f-43d5-8622-fa117ec29de2 req-40578fea-30be-4dc6-ab45-7f446eca2624 service nova] Enqueued Resource ID: 3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56 with Priority: HIGHEST for action security_group_rules [ 1032.792556] env[67094]: INFO networking_nsxv3.common.synchronization [req-f5981efc-cc5f-43d5-8622-fa117ec29de2 req-40578fea-30be-4dc6-ab45-7f446eca2624 service nova] Enqueued Resource ID: 3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56 with Priority: HIGHEST for action security_group_members [ 1032.792691] env[67094]: INFO networking_nsxv3.common.synchronization [req-f5981efc-cc5f-43d5-8622-fa117ec29de2 req-40578fea-30be-4dc6-ab45-7f446eca2624 service nova] Enqueued Resource ID: 79a575bb-d65c-49b0-a0a6-6bea2fc25144 with Priority: HIGHEST for action port [ 1032.794789] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56 with Priority: HIGHEST for action security_group_rules [ 1032.798022] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56 with Priority: HIGHEST for action security_group_members [ 1032.798022] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 79a575bb-d65c-49b0-a0a6-6bea2fc25144 with Priority: HIGHEST for action port [ 1032.799816] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.799997] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.800072] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.800240] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.800317] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.801552] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.801662] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.801724] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.801920] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.802093] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.802194] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.802251] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.802405] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.802485] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1032.802575] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1032.803383] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-79a575bb-d65c-49b0-a0a6-6bea2fc25144 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1032.803489] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-79a575bb-d65c-49b0-a0a6-6bea2fc25144" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1032.803545] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-79a575bb-d65c-49b0-a0a6-6bea2fc25144" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1032.804025] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-79a575bb-d65c-49b0-a0a6-6bea2fc25144" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1032.804025] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('79a575bb-d65c-49b0-a0a6-6bea2fc25144',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.222287] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.222498] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.222598] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.222894] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.223012] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.223122] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0881101-1be1-4dbf-ac18-2d54a689202c is going to be updated. [ 1033.256041] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.256262] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.256311] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.257028] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.257028] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.271096] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0881101-1be1-4dbf-ac18-2d54a689202c in Status: IN_PROGRESS for 2s [ 1033.280695] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.281384] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.281384] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.281384] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.306562] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.306562] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.306562] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.306562] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.306998] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.306998] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.306998] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04d0f31c-3c4e-40ac-a405-c43379f06123 is going to be updated. [ 1033.311029] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.311029] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.311029] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.311029] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 79a575bb-d65c-49b0-a0a6-6bea2fc25144 with status ACTIVE [ 1033.311029] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.311347] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.311347] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.311415] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.311552] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.311666] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.311763] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.312376] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.312376] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.312376] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.312376] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.312539] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.312539] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.312855] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.312855] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.312855] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 79a575bb-d65c-49b0-a0a6-6bea2fc25144 is going to be updated. [ 1033.320637] env[67094]: INFO networking_nsxv3.common.synchronization [req-a662af95-7945-4069-802c-fd01d1279952 req-99007d67-695e-4a76-8974-504a75dd8d53 tempest-ListServerFiltersTestJSON-1688651076 tempest-ListServerFiltersTestJSON-1688651076-project-member] Enqueued Resource ID: 78a2df96-bab9-40fe-b845-1eec3b7d8df2 with Priority: HIGHEST for action security_group_members [ 1033.321180] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78a2df96-bab9-40fe-b845-1eec3b7d8df2 with Priority: HIGHEST for action security_group_members [ 1033.322293] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-78a2df96-bab9-40fe-b845-1eec3b7d8df2 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.322293] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.322293] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.322601] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.322601] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.322709] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.322880] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.322947] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.322991] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.323074] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78a2df96-bab9-40fe-b845-1eec3b7d8df2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.334032] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.334199] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.334291] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.334562] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.334840] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.334884] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-79a575bb-d65c-49b0-a0a6-6bea2fc25144" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.344043] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.344043] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.344043] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.344278] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.345033] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.353933] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04d0f31c-3c4e-40ac-a405-c43379f06123 in Status: IN_PROGRESS for 2s [ 1033.658044] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b61bfa2d-4c26-4a49-a153-4a8fb6153ccd in Status: SUCCESS [ 1033.658044] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b61bfa2d-4c26-4a49-a153-4a8fb6153ccd" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.658744] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 5d6b6e19-f017-4eac-b0ac-ed1b17230d12 in Status: SUCCESS [ 1033.658958] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5d6b6e19-f017-4eac-b0ac-ed1b17230d12" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.672493] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 in Status: SUCCESS [ 1033.672493] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.741584] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock network-160 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.741882] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "network-160" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.742021] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "network-160" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.742264] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "network-160" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.742520] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.745682] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.746433] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.746433] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.746433] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.746433] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1033.746708] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1033.746708] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1033.746920] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1033.746920] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1033.747067] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1033.747235] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1033.767729] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1033.768524] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1033.768524] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1033.768704] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "network-160" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.769145] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock port-b887a17e-9105-4ef2-a2d7-58b672b298cf taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.769920] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "port-b887a17e-9105-4ef2-a2d7-58b672b298cf" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.769920] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "port-b887a17e-9105-4ef2-a2d7-58b672b298cf" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.769920] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "port-b887a17e-9105-4ef2-a2d7-58b672b298cf" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.770204] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b887a17e-9105-4ef2-a2d7-58b672b298cf',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.778749] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 280210af-8e3d-42c9-8854-42bd856b9dbe in Status: SUCCESS [ 1033.779468] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.791040] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 529c6563-9354-49e2-8282-acd28e0b0ef7 in Status: SUCCESS [ 1033.791397] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-529c6563-9354-49e2-8282-acd28e0b0ef7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.811064] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1033.825394] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.825590] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.825664] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.825872] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.825978] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.826217] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1033.826339] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1033.826399] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1033.826527] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1033.826635] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1033.826720] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78a2df96-bab9-40fe-b845-1eec3b7d8df2 already deleted. [ 1033.826793] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.272722] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.273130] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.273375] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.273803] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.274079] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.274343] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Segment Port b887a17e-9105-4ef2-a2d7-58b672b298cf not found, creating... [ 1034.274777] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.275063] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.275274] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.275623] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.275846] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.276287] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.276457] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.276576] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.276871] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.277117] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.277330] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Resource: SegmentPort with ID: b887a17e-9105-4ef2-a2d7-58b672b298cf is going to be created. [ 1034.314933] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.315212] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.315390] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.315812] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.316074] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.316173] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56 is going to be created. [ 1034.321912] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.322284] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.322563] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.323084] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.323179] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.323419] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "port-b887a17e-9105-4ef2-a2d7-58b672b298cf" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.359483] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1034.359654] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1034.359757] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1034.360251] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1034.360251] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1034.372062] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56 in Status: UNINITIALIZED for 2s [ 1034.438950] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7e9a1130-f6aa-45df-b627-3bebf6cbd9ff in Status: SUCCESS [ 1034.439069] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e9a1130-f6aa-45df-b627-3bebf6cbd9ff" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.036039] env[67094]: INFO networking_nsxv3.common.synchronization [req-a662af95-7945-4069-802c-fd01d1279952 req-2f934aad-dab5-4186-ba0a-53009461ebdc service nova] Enqueued Resource ID: 78a2df96-bab9-40fe-b845-1eec3b7d8df2 with Priority: HIGHEST for action security_group_rules [ 1035.036373] env[67094]: INFO networking_nsxv3.common.synchronization [req-a662af95-7945-4069-802c-fd01d1279952 req-2f934aad-dab5-4186-ba0a-53009461ebdc service nova] Enqueued Resource ID: 78a2df96-bab9-40fe-b845-1eec3b7d8df2 with Priority: HIGHEST for action security_group_members [ 1035.036456] env[67094]: INFO networking_nsxv3.common.synchronization [req-a662af95-7945-4069-802c-fd01d1279952 req-2f934aad-dab5-4186-ba0a-53009461ebdc service nova] Enqueued Resource ID: b887a17e-9105-4ef2-a2d7-58b672b298cf with Priority: HIGHEST for action port [ 1035.037301] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78a2df96-bab9-40fe-b845-1eec3b7d8df2 with Priority: HIGHEST for action security_group_rules [ 1035.037542] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78a2df96-bab9-40fe-b845-1eec3b7d8df2 with Priority: HIGHEST for action security_group_members [ 1035.038030] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b887a17e-9105-4ef2-a2d7-58b672b298cf with Priority: HIGHEST for action port [ 1035.038209] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78a2df96-bab9-40fe-b845-1eec3b7d8df2 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.038404] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.038524] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.038848] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.038980] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78a2df96-bab9-40fe-b845-1eec3b7d8df2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.040206] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-78a2df96-bab9-40fe-b845-1eec3b7d8df2 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.040206] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.040365] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.040424] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.040699] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.040699] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.040850] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.040911] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.040967] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.041038] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78a2df96-bab9-40fe-b845-1eec3b7d8df2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.043169] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-b887a17e-9105-4ef2-a2d7-58b672b298cf taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.043169] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b887a17e-9105-4ef2-a2d7-58b672b298cf" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.043169] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b887a17e-9105-4ef2-a2d7-58b672b298cf" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.043169] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b887a17e-9105-4ef2-a2d7-58b672b298cf" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.043169] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b887a17e-9105-4ef2-a2d7-58b672b298cf',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.293318] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0881101-1be1-4dbf-ac18-2d54a689202c in Status: SUCCESS [ 1035.293596] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.367358] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 04d0f31c-3c4e-40ac-a405-c43379f06123 in Status: SUCCESS [ 1035.367656] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 04d0f31c-3c4e-40ac-a405-c43379f06123 deletion is rescheduled due to dependency. [ 1035.367782] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-04d0f31c-3c4e-40ac-a405-c43379f06123" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.544247] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-78a2df96-bab9-40fe-b845-1eec3b7d8df2 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.544421] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.549812] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('78a2df96-bab9-40fe-b845-1eec3b7d8df2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1035.549812] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b887a17e-9105-4ef2-a2d7-58b672b298cf with status ACTIVE [ 1035.549812] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.549812] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.549812] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.549812] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.549812] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.549812] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.549812] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.549812] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.549812] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.549812] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.549812] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.549812] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.551241] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.551241] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.551241] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.551397] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b887a17e-9105-4ef2-a2d7-58b672b298cf is going to be updated. [ 1035.582033] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1035.582213] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1035.582213] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1035.582480] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1035.583448] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1035.583448] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b887a17e-9105-4ef2-a2d7-58b672b298cf" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.055144] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('78a2df96-bab9-40fe-b845-1eec3b7d8df2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.385462] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56 in Status: SUCCESS [ 1036.385462] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.385462] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.385462] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.385462] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.385462] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.385795] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.385795] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.385795] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.385914] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.385914] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1036.558306] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.558474] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.558600] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.558747] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.558823] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.558924] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78a2df96-bab9-40fe-b845-1eec3b7d8df2 is going to be created. [ 1036.586331] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1036.586528] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1036.586601] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1036.586860] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1036.587068] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1036.599283] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78a2df96-bab9-40fe-b845-1eec3b7d8df2 in Status: UNINITIALIZED for 2s [ 1036.888197] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1037.390862] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56: rpc.has_security_group_logging(os_id): False [ 1037.415243] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.415453] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.415453] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.415682] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.415771] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.416037] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.416141] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.416205] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.416354] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.416432] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.416535] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56 is going to be created. [ 1037.489214] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1037.489214] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1037.489214] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1037.489214] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1037.489214] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1037.504640] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56 in Status: IN_PROGRESS for 2s [ 1038.416392] env[67094]: INFO networking_nsxv3.common.synchronization [req-da306945-1df3-48ae-a698-fa712cd2310b req-0d2b5663-c9ac-4b69-97c1-466c8d44ddfb tempest-ListServerFiltersTestJSON-1688651076 tempest-ListServerFiltersTestJSON-1688651076-project-member] Enqueued Resource ID: 78a2df96-bab9-40fe-b845-1eec3b7d8df2 with Priority: HIGHEST for action security_group_members [ 1038.417924] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78a2df96-bab9-40fe-b845-1eec3b7d8df2 with Priority: HIGHEST for action security_group_members [ 1038.418268] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-78a2df96-bab9-40fe-b845-1eec3b7d8df2 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.418371] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.610731] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78a2df96-bab9-40fe-b845-1eec3b7d8df2 in Status: SUCCESS [ 1038.611031] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.611200] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.611663] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.611867] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.611986] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.612069] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.612220] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.612300] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.612388] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.612477] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('78a2df96-bab9-40fe-b845-1eec3b7d8df2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.613340] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.615154] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.615995] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.616274] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.616538] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.616809] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.616992] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.617288] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78a2df96-bab9-40fe-b845-1eec3b7d8df2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1038.903651] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock network-160 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.903651] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "network-160" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.903651] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "network-160" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.903651] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "network-160" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.903651] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.903987] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.904232] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.904916] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.905276] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.905704] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1038.905994] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1038.907825] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1038.907825] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1038.907825] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1038.907825] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1038.907825] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1038.929227] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1038.930082] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1038.930082] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1038.930082] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "network-160" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1038.930245] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock port-68a0fa43-cc3f-4a3b-844a-8dea652e20f1 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1038.930335] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "port-68a0fa43-cc3f-4a3b-844a-8dea652e20f1" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1038.930438] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "port-68a0fa43-cc3f-4a3b-844a-8dea652e20f1" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1038.930786] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "port-68a0fa43-cc3f-4a3b-844a-8dea652e20f1" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1038.930992] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68a0fa43-cc3f-4a3b-844a-8dea652e20f1',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.120071] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-78a2df96-bab9-40fe-b845-1eec3b7d8df2 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.120297] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.120475] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('78a2df96-bab9-40fe-b845-1eec3b7d8df2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.292399] env[67094]: INFO networking_nsxv3.common.synchronization [req-232fccff-fd37-41f0-b94b-32e2bf5a04f0 req-39ed7b59-25f9-41ff-9947-6c7cc7983d69 tempest-ServerActionsTestOtherB-1168296312 tempest-ServerActionsTestOtherB-1168296312-project-member] Enqueued Resource ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 with Priority: HIGHEST for action security_group_members [ 1039.292998] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 with Priority: HIGHEST for action security_group_members [ 1039.293421] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.293565] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.293635] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.293916] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.294159] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.294297] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.294363] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.294556] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.294661] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.294732] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.433150] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.434271] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.434271] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.434271] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.434271] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.434271] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Segment Port 68a0fa43-cc3f-4a3b-844a-8dea652e20f1 not found, creating... [ 1039.434920] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.434920] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.434920] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.434920] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.435201] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.435666] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.435666] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.435666] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.435666] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.435948] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.435948] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Resource: SegmentPort with ID: 68a0fa43-cc3f-4a3b-844a-8dea652e20f1 is going to be created. [ 1039.459598] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.459929] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.460150] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.460531] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.460861] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.461198] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "port-68a0fa43-cc3f-4a3b-844a-8dea652e20f1" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.519085] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56 in Status: SUCCESS [ 1039.519388] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.544916] env[67094]: INFO networking_nsxv3.common.synchronization [None req-24acbd7c-1898-418a-a999-3ba5c807eeb3 None None] Enqueued Resource ID: 9b53d41e-6f58-40d5-85c6-0818c5505f22 with Priority: HIGHEST for action port [ 1039.546027] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9b53d41e-6f58-40d5-85c6-0818c5505f22 with Priority: HIGHEST for action port [ 1039.546027] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-9b53d41e-6f58-40d5-85c6-0818c5505f22 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.546462] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9b53d41e-6f58-40d5-85c6-0818c5505f22" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.546572] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9b53d41e-6f58-40d5-85c6-0818c5505f22" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.546905] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9b53d41e-6f58-40d5-85c6-0818c5505f22" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.547269] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9b53d41e-6f58-40d5-85c6-0818c5505f22',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.622473] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('78a2df96-bab9-40fe-b845-1eec3b7d8df2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1039.799163] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.799348] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.799455] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.799727] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.800769] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.800769] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.800769] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.800769] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.800769] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.800769] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.801226] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 is going to be updated. [ 1039.838938] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1039.839151] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1039.839151] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1039.839371] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1039.839506] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1039.849380] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 in Status: IN_PROGRESS for 2s [ 1040.048918] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9b53d41e-6f58-40d5-85c6-0818c5505f22 [ 1040.049174] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.049307] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.049997] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.049997] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.049997] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.049997] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9b53d41e-6f58-40d5-85c6-0818c5505f22 already deleted. [ 1040.049997] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9b53d41e-6f58-40d5-85c6-0818c5505f22" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.125371] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.125680] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.125859] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.126178] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.126310] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.126818] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78a2df96-bab9-40fe-b845-1eec3b7d8df2 is going to be updated. [ 1040.154414] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.154576] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.154622] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.154849] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.155050] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.166782] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78a2df96-bab9-40fe-b845-1eec3b7d8df2 in Status: IN_PROGRESS for 2s [ 1040.238577] env[67094]: INFO networking_nsxv3.common.synchronization [req-da306945-1df3-48ae-a698-fa712cd2310b req-2d44f464-f261-4063-b40f-92d1d89d14c3 service nova] Enqueued Resource ID: 78a2df96-bab9-40fe-b845-1eec3b7d8df2 with Priority: HIGHEST for action security_group_rules [ 1040.238577] env[67094]: INFO networking_nsxv3.common.synchronization [req-da306945-1df3-48ae-a698-fa712cd2310b req-2d44f464-f261-4063-b40f-92d1d89d14c3 service nova] Enqueued Resource ID: 78a2df96-bab9-40fe-b845-1eec3b7d8df2 with Priority: HIGHEST for action security_group_members [ 1040.238817] env[67094]: INFO networking_nsxv3.common.synchronization [req-da306945-1df3-48ae-a698-fa712cd2310b req-2d44f464-f261-4063-b40f-92d1d89d14c3 service nova] Enqueued Resource ID: 68a0fa43-cc3f-4a3b-844a-8dea652e20f1 with Priority: HIGHEST for action port [ 1040.239245] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78a2df96-bab9-40fe-b845-1eec3b7d8df2 with Priority: HIGHEST for action security_group_rules [ 1040.239377] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78a2df96-bab9-40fe-b845-1eec3b7d8df2 with Priority: HIGHEST for action security_group_members [ 1040.239534] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 68a0fa43-cc3f-4a3b-844a-8dea652e20f1 with Priority: HIGHEST for action port [ 1040.239862] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78a2df96-bab9-40fe-b845-1eec3b7d8df2 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.240022] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.240530] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-78a2df96-bab9-40fe-b845-1eec3b7d8df2 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.240530] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.240530] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-68a0fa43-cc3f-4a3b-844a-8dea652e20f1 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.240766] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-68a0fa43-cc3f-4a3b-844a-8dea652e20f1" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.240766] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-68a0fa43-cc3f-4a3b-844a-8dea652e20f1" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.242776] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-68a0fa43-cc3f-4a3b-844a-8dea652e20f1" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.242776] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('68a0fa43-cc3f-4a3b-844a-8dea652e20f1',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1040.743504] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 68a0fa43-cc3f-4a3b-844a-8dea652e20f1 with status ACTIVE [ 1040.743944] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.743944] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.743944] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.744175] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.744175] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.744412] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.744515] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.744515] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.744628] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.744715] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.744913] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.745056] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.745056] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.745206] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.745280] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.745357] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 68a0fa43-cc3f-4a3b-844a-8dea652e20f1 is going to be updated. [ 1040.775615] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1040.775814] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1040.775814] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1040.775993] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1040.776154] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1040.776314] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-68a0fa43-cc3f-4a3b-844a-8dea652e20f1" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.323384] env[67094]: INFO networking_nsxv3.common.synchronization [req-c4eaa91c-1fa0-4573-8bce-5c0bcb4cf9d9 req-f3e5e2d4-92bb-499b-99e9-f7a8d76c5f83 tempest-ListServerFiltersTestJSON-1688651076 tempest-ListServerFiltersTestJSON-1688651076-project-member] Enqueued Resource ID: 78a2df96-bab9-40fe-b845-1eec3b7d8df2 with Priority: HIGHEST for action security_group_members [ 1041.327912] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78a2df96-bab9-40fe-b845-1eec3b7d8df2 with Priority: HIGHEST for action security_group_members [ 1041.328720] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-78a2df96-bab9-40fe-b845-1eec3b7d8df2 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.328720] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.789194] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock network-160 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.790772] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "network-160" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.790772] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "network-160" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.791119] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "network-160" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.794645] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.794645] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.794645] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.794645] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.794645] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.794645] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1041.794645] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1041.794645] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1041.794645] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1041.794645] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1041.794645] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1041.794645] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1041.816039] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1041.816039] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1041.816039] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1041.816039] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "network-160" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.816039] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock port-d6df2c9d-fbce-4a7a-a475-6b7e01f2c480 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.816039] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "port-d6df2c9d-fbce-4a7a-a475-6b7e01f2c480" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.816039] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "port-d6df2c9d-fbce-4a7a-a475-6b7e01f2c480" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.816039] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "port-d6df2c9d-fbce-4a7a-a475-6b7e01f2c480" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.816039] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6df2c9d-fbce-4a7a-a475-6b7e01f2c480',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1041.860486] env[67094]: INFO networking_nsxv3.common.synchronization [None req-de4ae589-b50d-4d96-b1b8-da33dab231d7 None None] Enqueued Resource ID: 0f27f04f-299d-4818-89b0-e53b681226b5 with Priority: HIGHEST for action port [ 1041.862097] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 in Status: SUCCESS [ 1041.862420] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 deletion is rescheduled due to dependency. [ 1041.862654] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1041.865272] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f27f04f-299d-4818-89b0-e53b681226b5 with Priority: HIGHEST for action port [ 1041.865272] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-0f27f04f-299d-4818-89b0-e53b681226b5 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1041.865272] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-0f27f04f-299d-4818-89b0-e53b681226b5" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1041.865272] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-0f27f04f-299d-4818-89b0-e53b681226b5" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1041.865272] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-0f27f04f-299d-4818-89b0-e53b681226b5" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1041.865272] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('0f27f04f-299d-4818-89b0-e53b681226b5',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.047449] env[67094]: INFO networking_nsxv3.common.synchronization [None req-33264bab-00fe-40ed-8832-3f97e774feaa tempest-ServersTestBootFromVolume-467953286 tempest-ServersTestBootFromVolume-467953286-project-member] Enqueued Resource ID: 7d339cc8-3c0d-42f5-b975-687230de264b with Priority: HIGHEST for action security_group_rules [ 1042.048357] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d339cc8-3c0d-42f5-b975-687230de264b with Priority: HIGHEST for action security_group_rules [ 1042.048841] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d339cc8-3c0d-42f5-b975-687230de264b taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.049202] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d339cc8-3c0d-42f5-b975-687230de264b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.049202] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d339cc8-3c0d-42f5-b975-687230de264b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.049351] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d339cc8-3c0d-42f5-b975-687230de264b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.049420] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d339cc8-3c0d-42f5-b975-687230de264b',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.180030] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78a2df96-bab9-40fe-b845-1eec3b7d8df2 in Status: SUCCESS [ 1042.180030] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.180030] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.180030] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.180030] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.180030] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.180030] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.180030] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.180030] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.180030] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.180030] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-78a2df96-bab9-40fe-b845-1eec3b7d8df2 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.180030] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.180030] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.180030] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.180030] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.180030] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.180030] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.180030] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.180030] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.181212] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.181212] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('78a2df96-bab9-40fe-b845-1eec3b7d8df2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.182118] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.182428] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.182701] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.182959] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.183139] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.183389] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.183594] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.183809] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78a2df96-bab9-40fe-b845-1eec3b7d8df2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.226882] env[67094]: INFO networking_nsxv3.common.synchronization [None req-852cc4a7-13a4-428a-8890-887b079b606f tempest-ServersTestBootFromVolume-467953286 tempest-ServersTestBootFromVolume-467953286-project-member] Enqueued Resource ID: 7d339cc8-3c0d-42f5-b975-687230de264b with Priority: HIGHEST for action security_group_rules [ 1042.227528] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d339cc8-3c0d-42f5-b975-687230de264b with Priority: HIGHEST for action security_group_rules [ 1042.228209] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d339cc8-3c0d-42f5-b975-687230de264b taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.228378] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d339cc8-3c0d-42f5-b975-687230de264b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.318816] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.319116] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.319221] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.320330] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.320330] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.320330] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Segment Port d6df2c9d-fbce-4a7a-a475-6b7e01f2c480 not found, creating... [ 1042.320330] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.320330] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.320578] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.320732] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.320920] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.321437] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.321618] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.321736] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.321959] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.322138] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.322312] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Resource: SegmentPort with ID: d6df2c9d-fbce-4a7a-a475-6b7e01f2c480 is going to be created. [ 1042.348159] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.348159] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.348159] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.349538] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.349538] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.349538] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "port-d6df2c9d-fbce-4a7a-a475-6b7e01f2c480" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.367188] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 0f27f04f-299d-4818-89b0-e53b681226b5 [ 1042.367615] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.368847] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.368847] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.368847] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.368847] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.368847] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:0f27f04f-299d-4818-89b0-e53b681226b5 already deleted. [ 1042.368847] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-0f27f04f-299d-4818-89b0-e53b681226b5" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.575055] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.575356] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.575356] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.575520] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.575587] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.575675] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d339cc8-3c0d-42f5-b975-687230de264b already deleted. [ 1042.575755] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d339cc8-3c0d-42f5-b975-687230de264b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.575914] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d339cc8-3c0d-42f5-b975-687230de264b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.576088] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d339cc8-3c0d-42f5-b975-687230de264b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.576167] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d339cc8-3c0d-42f5-b975-687230de264b',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.687754] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 78a2df96-bab9-40fe-b845-1eec3b7d8df2: rpc.has_security_group_logging(os_id): False [ 1042.688947] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('78a2df96-bab9-40fe-b845-1eec3b7d8df2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1042.708173] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.708421] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.708421] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.708591] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.708769] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.708912] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.709050] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.709050] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.709159] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.709235] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.709435] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.709527] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.709587] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.709724] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.709968] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.710273] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.710328] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.710369] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.710529] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.710871] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.710871] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78a2df96-bab9-40fe-b845-1eec3b7d8df2 is going to be created. [ 1042.779192] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1042.780033] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1042.780033] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1042.780033] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1042.780244] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1042.800713] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78a2df96-bab9-40fe-b845-1eec3b7d8df2 in Status: IN_PROGRESS for 2s [ 1043.102322] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.105013] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.105013] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.105013] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.105013] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.105013] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d339cc8-3c0d-42f5-b975-687230de264b already deleted. [ 1043.105013] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d339cc8-3c0d-42f5-b975-687230de264b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.147564] env[67094]: INFO networking_nsxv3.common.synchronization [req-c4eaa91c-1fa0-4573-8bce-5c0bcb4cf9d9 req-c5afd2ac-1212-42ca-a667-f413039534c1 service nova] Enqueued Resource ID: 78a2df96-bab9-40fe-b845-1eec3b7d8df2 with Priority: HIGHEST for action security_group_rules [ 1043.147564] env[67094]: INFO networking_nsxv3.common.synchronization [req-c4eaa91c-1fa0-4573-8bce-5c0bcb4cf9d9 req-c5afd2ac-1212-42ca-a667-f413039534c1 service nova] Enqueued Resource ID: 78a2df96-bab9-40fe-b845-1eec3b7d8df2 with Priority: HIGHEST for action security_group_members [ 1043.147564] env[67094]: INFO networking_nsxv3.common.synchronization [req-c4eaa91c-1fa0-4573-8bce-5c0bcb4cf9d9 req-c5afd2ac-1212-42ca-a667-f413039534c1 service nova] Enqueued Resource ID: d6df2c9d-fbce-4a7a-a475-6b7e01f2c480 with Priority: HIGHEST for action port [ 1043.148231] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78a2df96-bab9-40fe-b845-1eec3b7d8df2 with Priority: HIGHEST for action security_group_rules [ 1043.148349] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78a2df96-bab9-40fe-b845-1eec3b7d8df2 with Priority: HIGHEST for action security_group_members [ 1043.151027] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d6df2c9d-fbce-4a7a-a475-6b7e01f2c480 with Priority: HIGHEST for action port [ 1043.151027] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78a2df96-bab9-40fe-b845-1eec3b7d8df2 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.151027] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.151027] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-78a2df96-bab9-40fe-b845-1eec3b7d8df2 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.151027] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.151027] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-d6df2c9d-fbce-4a7a-a475-6b7e01f2c480 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.154137] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d6df2c9d-fbce-4a7a-a475-6b7e01f2c480" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.154972] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d6df2c9d-fbce-4a7a-a475-6b7e01f2c480" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.154972] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d6df2c9d-fbce-4a7a-a475-6b7e01f2c480" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.154972] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d6df2c9d-fbce-4a7a-a475-6b7e01f2c480',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.192204] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('78a2df96-bab9-40fe-b845-1eec3b7d8df2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.595830] env[67094]: INFO networking_nsxv3.common.synchronization [req-056968dc-f87c-49c5-aded-fba3613b8ec9 req-0dec717c-8d57-442d-8ec1-bd1b3c2e9d3f tempest-ServerAddressesNegativeTestJSON-661804951 tempest-ServerAddressesNegativeTestJSON-661804951-project-member] Enqueued Resource ID: 7516d25f-7616-41dc-9575-16a9cddc1840 with Priority: HIGHEST for action security_group_members [ 1043.595830] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7516d25f-7616-41dc-9575-16a9cddc1840 with Priority: HIGHEST for action security_group_members [ 1043.597292] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-7516d25f-7616-41dc-9575-16a9cddc1840 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.597594] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7516d25f-7616-41dc-9575-16a9cddc1840" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.597816] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7516d25f-7616-41dc-9575-16a9cddc1840" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.598588] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7516d25f-7616-41dc-9575-16a9cddc1840" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.599353] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.599353] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.599353] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.599353] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.599353] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.599617] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7516d25f-7616-41dc-9575-16a9cddc1840',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1043.656698] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d6df2c9d-fbce-4a7a-a475-6b7e01f2c480 with status ACTIVE [ 1043.657008] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.657216] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.657216] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.657447] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.657536] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.657752] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.657827] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.657904] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.658089] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.658151] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.658311] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.658399] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.658450] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.658590] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.658661] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.658745] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d6df2c9d-fbce-4a7a-a475-6b7e01f2c480 is going to be updated. [ 1043.684553] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.684553] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.684553] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.684553] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.684553] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.684553] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d6df2c9d-fbce-4a7a-a475-6b7e01f2c480" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.695675] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.695675] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.695675] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.695675] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.695675] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.695675] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78a2df96-bab9-40fe-b845-1eec3b7d8df2 is going to be updated. [ 1043.741087] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.741326] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.741447] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.741710] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.741865] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.767753] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78a2df96-bab9-40fe-b845-1eec3b7d8df2 in Status: IN_PROGRESS for 2s [ 1043.972447] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock network-15 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.972877] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "network-15" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.973056] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "network-15" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.973631] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "network-15" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.974012] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1043.974559] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1043.974559] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1043.974943] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1043.975344] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1043.975700] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1043.975903] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1043.976140] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1043.976369] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1043.976628] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1043.976844] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1043.977084] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1043.998734] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1043.999043] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1043.999244] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1043.999522] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "network-15" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.000042] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock port-c8e89c5a-a81f-4e69-a7e7-79d183e70265 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.000316] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "port-c8e89c5a-a81f-4e69-a7e7-79d183e70265" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.000513] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "port-c8e89c5a-a81f-4e69-a7e7-79d183e70265" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.000990] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "port-c8e89c5a-a81f-4e69-a7e7-79d183e70265" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.001227] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c8e89c5a-a81f-4e69-a7e7-79d183e70265',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.106813] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.106813] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.106813] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.107065] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.107961] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.108206] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.108328] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.108388] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.108574] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.108662] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.108750] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7516d25f-7616-41dc-9575-16a9cddc1840 already deleted. [ 1044.108833] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7516d25f-7616-41dc-9575-16a9cddc1840" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.249390] env[67094]: INFO networking_nsxv3.common.synchronization [req-45081045-b396-4f85-a6fc-531749045fc5 req-0ba32460-5ddb-4341-ad23-4dc35c49ef19 tempest-AttachVolumeTestJSON-829034394 tempest-AttachVolumeTestJSON-829034394-project-member] Enqueued Resource ID: 529c6563-9354-49e2-8282-acd28e0b0ef7 with Priority: HIGHEST for action security_group_members [ 1044.249981] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 529c6563-9354-49e2-8282-acd28e0b0ef7 with Priority: HIGHEST for action security_group_members [ 1044.250298] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-529c6563-9354-49e2-8282-acd28e0b0ef7 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.250423] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-529c6563-9354-49e2-8282-acd28e0b0ef7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.250481] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-529c6563-9354-49e2-8282-acd28e0b0ef7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.250677] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-529c6563-9354-49e2-8282-acd28e0b0ef7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.250852] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.250970] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.251063] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.251211] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.251293] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.251388] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('529c6563-9354-49e2-8282-acd28e0b0ef7',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1044.506538] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.506865] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.507563] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.507884] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.508044] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.508314] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Segment Port c8e89c5a-a81f-4e69-a7e7-79d183e70265 not found, creating... [ 1044.508701] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.508936] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.509096] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.509320] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.509577] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.509837] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.510071] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.510245] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.510468] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.510602] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.510739] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Resource: SegmentPort with ID: c8e89c5a-a81f-4e69-a7e7-79d183e70265 is going to be created. [ 1044.531794] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.532088] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.532179] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.532515] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.532763] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.532984] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "port-c8e89c5a-a81f-4e69-a7e7-79d183e70265" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.753696] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.753909] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.754542] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.754795] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.754897] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.755131] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.755287] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.755351] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.755518] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.755594] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.755690] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 529c6563-9354-49e2-8282-acd28e0b0ef7 is going to be updated. [ 1044.787548] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1044.787733] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1044.787733] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.788537] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.788537] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.799934] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 529c6563-9354-49e2-8282-acd28e0b0ef7 in Status: IN_PROGRESS for 2s [ 1044.816450] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78a2df96-bab9-40fe-b845-1eec3b7d8df2 in Status: SUCCESS [ 1044.816450] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1044.816450] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1044.816450] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1044.816450] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78a2df96-bab9-40fe-b845-1eec3b7d8df2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.247130] env[67094]: INFO networking_nsxv3.common.synchronization [req-056968dc-f87c-49c5-aded-fba3613b8ec9 req-4e6d12f7-7ff0-4518-955f-7a3bc684a450 service nova] Enqueued Resource ID: 7516d25f-7616-41dc-9575-16a9cddc1840 with Priority: HIGHEST for action security_group_rules [ 1045.247537] env[67094]: INFO networking_nsxv3.common.synchronization [req-056968dc-f87c-49c5-aded-fba3613b8ec9 req-4e6d12f7-7ff0-4518-955f-7a3bc684a450 service nova] Enqueued Resource ID: 7516d25f-7616-41dc-9575-16a9cddc1840 with Priority: HIGHEST for action security_group_members [ 1045.247680] env[67094]: INFO networking_nsxv3.common.synchronization [req-056968dc-f87c-49c5-aded-fba3613b8ec9 req-4e6d12f7-7ff0-4518-955f-7a3bc684a450 service nova] Enqueued Resource ID: c8e89c5a-a81f-4e69-a7e7-79d183e70265 with Priority: HIGHEST for action port [ 1045.248540] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7516d25f-7616-41dc-9575-16a9cddc1840 with Priority: HIGHEST for action security_group_rules [ 1045.248703] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7516d25f-7616-41dc-9575-16a9cddc1840 with Priority: HIGHEST for action security_group_members [ 1045.248807] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c8e89c5a-a81f-4e69-a7e7-79d183e70265 with Priority: HIGHEST for action port [ 1045.249438] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7516d25f-7616-41dc-9575-16a9cddc1840 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.249438] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7516d25f-7616-41dc-9575-16a9cddc1840" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.249438] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7516d25f-7616-41dc-9575-16a9cddc1840" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.249721] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7516d25f-7616-41dc-9575-16a9cddc1840" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.250088] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7516d25f-7616-41dc-9575-16a9cddc1840',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.250927] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-7516d25f-7616-41dc-9575-16a9cddc1840 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.251018] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7516d25f-7616-41dc-9575-16a9cddc1840" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.251091] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7516d25f-7616-41dc-9575-16a9cddc1840" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.251299] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7516d25f-7616-41dc-9575-16a9cddc1840" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.252370] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.252370] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.252370] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.252370] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.252370] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.252370] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7516d25f-7616-41dc-9575-16a9cddc1840',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.253041] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-c8e89c5a-a81f-4e69-a7e7-79d183e70265 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.253041] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-c8e89c5a-a81f-4e69-a7e7-79d183e70265" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.253220] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-c8e89c5a-a81f-4e69-a7e7-79d183e70265" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.253313] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-c8e89c5a-a81f-4e69-a7e7-79d183e70265" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.253347] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('c8e89c5a-a81f-4e69-a7e7-79d183e70265',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.319238] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-78a2df96-bab9-40fe-b845-1eec3b7d8df2 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.319238] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.755497] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-7516d25f-7616-41dc-9575-16a9cddc1840 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.755497] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7516d25f-7616-41dc-9575-16a9cddc1840" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.757086] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7516d25f-7616-41dc-9575-16a9cddc1840',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.757833] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port c8e89c5a-a81f-4e69-a7e7-79d183e70265 with status ACTIVE [ 1045.758051] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.758862] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.758862] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.758862] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.758862] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.759202] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.760194] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.760327] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.760500] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.760582] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.764043] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.764043] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.764043] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.764043] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.764043] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.764043] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: c8e89c5a-a81f-4e69-a7e7-79d183e70265 is going to be updated. [ 1045.787592] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78a2df96-bab9-40fe-b845-1eec3b7d8df2 in Status: SUCCESS [ 1045.787592] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.787786] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.788026] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.788226] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.788343] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.788409] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.788559] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.788677] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.788779] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78a2df96-bab9-40fe-b845-1eec3b7d8df2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1045.796526] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1045.796678] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1045.796746] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1045.797012] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1045.797162] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1045.797328] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-c8e89c5a-a81f-4e69-a7e7-79d183e70265" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.263431] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7516d25f-7616-41dc-9575-16a9cddc1840',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.295941] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('78a2df96-bab9-40fe-b845-1eec3b7d8df2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.766369] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.766558] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.766624] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.766812] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.766900] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.767015] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7516d25f-7616-41dc-9575-16a9cddc1840 is going to be created. [ 1046.791699] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1046.791795] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1046.791850] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1046.792035] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1046.792233] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1046.800034] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('78a2df96-bab9-40fe-b845-1eec3b7d8df2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1046.802631] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7516d25f-7616-41dc-9575-16a9cddc1840 in Status: UNINITIALIZED for 2s [ 1046.810369] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 529c6563-9354-49e2-8282-acd28e0b0ef7 in Status: SUCCESS [ 1046.810559] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 529c6563-9354-49e2-8282-acd28e0b0ef7 deletion is rescheduled due to dependency. [ 1046.810659] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-529c6563-9354-49e2-8282-acd28e0b0ef7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.303631] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.304250] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.304250] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.304250] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.304250] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.304449] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78a2df96-bab9-40fe-b845-1eec3b7d8df2 is going to be updated. [ 1047.353193] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1047.353433] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1047.353433] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1047.353629] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1047.353784] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1047.363287] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78a2df96-bab9-40fe-b845-1eec3b7d8df2 in Status: IN_PROGRESS for 2s [ 1048.158461] env[67094]: INFO networking_nsxv3.common.synchronization [req-20166e53-2650-4d1a-a76f-2e1035ff0486 req-239ef49e-9b8c-4f95-a705-82f3deac021a tempest-AttachInterfacesTestJSON-1117082489 tempest-AttachInterfacesTestJSON-1117082489-project-member] Enqueued Resource ID: 8c8bcd5f-7602-4632-8046-daa41c621837 with Priority: HIGHEST for action security_group_members [ 1048.159130] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c8bcd5f-7602-4632-8046-daa41c621837 with Priority: HIGHEST for action security_group_members [ 1048.159498] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c8bcd5f-7602-4632-8046-daa41c621837 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.159649] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c8bcd5f-7602-4632-8046-daa41c621837" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.159735] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c8bcd5f-7602-4632-8046-daa41c621837" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.160132] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c8bcd5f-7602-4632-8046-daa41c621837" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.160265] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.160382] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.160456] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.160625] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.160728] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.160908] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c8bcd5f-7602-4632-8046-daa41c621837',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.502715] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock network-766 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.503115] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "network-766" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.503329] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "network-766" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.503690] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "network-766" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.504087] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.504337] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.504499] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.504878] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.505122] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.505430] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1048.505590] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1048.505739] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1048.505890] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1048.506064] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1048.506213] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1048.506392] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1048.527232] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1048.527409] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1048.527607] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1048.527746] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "network-766" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.528130] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock port-fe142464-8b4e-4597-8227-66452db3b27b taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.528334] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "port-fe142464-8b4e-4597-8227-66452db3b27b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.528487] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "port-fe142464-8b4e-4597-8227-66452db3b27b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.528893] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "port-fe142464-8b4e-4597-8227-66452db3b27b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.529430] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe142464-8b4e-4597-8227-66452db3b27b',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1048.663151] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.663341] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.663417] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.663705] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.663806] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.664035] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.664152] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.664205] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.664397] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.664480] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.664569] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c8bcd5f-7602-4632-8046-daa41c621837 already deleted. [ 1048.664652] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c8bcd5f-7602-4632-8046-daa41c621837" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.815301] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7516d25f-7616-41dc-9575-16a9cddc1840 in Status: SUCCESS [ 1048.816046] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7516d25f-7616-41dc-9575-16a9cddc1840" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.816046] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7516d25f-7616-41dc-9575-16a9cddc1840" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.817362] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7516d25f-7616-41dc-9575-16a9cddc1840" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.817362] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1048.817362] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1048.817362] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1048.817362] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1048.817362] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.817362] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7516d25f-7616-41dc-9575-16a9cddc1840" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1048.817362] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7516d25f-7616-41dc-9575-16a9cddc1840',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.031918] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.032189] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.032317] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.032607] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.032756] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.032960] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Segment Port fe142464-8b4e-4597-8227-66452db3b27b not found, creating... [ 1049.033303] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.033493] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.033663] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.033971] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.034136] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.034421] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.034575] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.034688] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.034958] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.035135] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.035284] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Resource: SegmentPort with ID: fe142464-8b4e-4597-8227-66452db3b27b is going to be created. [ 1049.057801] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.057801] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.057801] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.058158] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.058333] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.058596] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "port-fe142464-8b4e-4597-8227-66452db3b27b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.325258] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-7516d25f-7616-41dc-9575-16a9cddc1840 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.325258] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7516d25f-7616-41dc-9575-16a9cddc1840" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.325258] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7516d25f-7616-41dc-9575-16a9cddc1840" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.325258] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7516d25f-7616-41dc-9575-16a9cddc1840" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.325258] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.325258] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.325258] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.325258] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.325258] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.325258] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7516d25f-7616-41dc-9575-16a9cddc1840" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.325258] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-7516d25f-7616-41dc-9575-16a9cddc1840 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.325258] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7516d25f-7616-41dc-9575-16a9cddc1840" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.325258] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7516d25f-7616-41dc-9575-16a9cddc1840" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.325258] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7516d25f-7616-41dc-9575-16a9cddc1840" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.325258] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.325258] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.326223] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.326223] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.326223] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.326223] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7516d25f-7616-41dc-9575-16a9cddc1840" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.326223] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7516d25f-7616-41dc-9575-16a9cddc1840',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.373839] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78a2df96-bab9-40fe-b845-1eec3b7d8df2 in Status: SUCCESS [ 1049.375208] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.375208] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.375208] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.375208] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.375208] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.375208] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.375208] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.375208] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.375208] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78a2df96-bab9-40fe-b845-1eec3b7d8df2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.781731] env[67094]: INFO networking_nsxv3.common.synchronization [req-20166e53-2650-4d1a-a76f-2e1035ff0486 req-f19f1724-8eb3-4f70-a6ce-566cae6ae2e8 service nova] Enqueued Resource ID: 8c8bcd5f-7602-4632-8046-daa41c621837 with Priority: HIGHEST for action security_group_rules [ 1049.782048] env[67094]: INFO networking_nsxv3.common.synchronization [req-20166e53-2650-4d1a-a76f-2e1035ff0486 req-f19f1724-8eb3-4f70-a6ce-566cae6ae2e8 service nova] Enqueued Resource ID: 8c8bcd5f-7602-4632-8046-daa41c621837 with Priority: HIGHEST for action security_group_members [ 1049.782132] env[67094]: INFO networking_nsxv3.common.synchronization [req-20166e53-2650-4d1a-a76f-2e1035ff0486 req-f19f1724-8eb3-4f70-a6ce-566cae6ae2e8 service nova] Enqueued Resource ID: fe142464-8b4e-4597-8227-66452db3b27b with Priority: HIGHEST for action port [ 1049.782677] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c8bcd5f-7602-4632-8046-daa41c621837 with Priority: HIGHEST for action security_group_rules [ 1049.783175] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c8bcd5f-7602-4632-8046-daa41c621837 with Priority: HIGHEST for action security_group_members [ 1049.783397] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fe142464-8b4e-4597-8227-66452db3b27b with Priority: HIGHEST for action port [ 1049.783614] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c8bcd5f-7602-4632-8046-daa41c621837 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.783734] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c8bcd5f-7602-4632-8046-daa41c621837" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.783792] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c8bcd5f-7602-4632-8046-daa41c621837" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.783986] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c8bcd5f-7602-4632-8046-daa41c621837" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.784071] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c8bcd5f-7602-4632-8046-daa41c621837',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.784922] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c8bcd5f-7602-4632-8046-daa41c621837 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.788027] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c8bcd5f-7602-4632-8046-daa41c621837" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.788027] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c8bcd5f-7602-4632-8046-daa41c621837" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.788027] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c8bcd5f-7602-4632-8046-daa41c621837" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.788027] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.788027] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.788027] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.788027] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.788027] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.788027] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c8bcd5f-7602-4632-8046-daa41c621837',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.788027] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-fe142464-8b4e-4597-8227-66452db3b27b taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.788027] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fe142464-8b4e-4597-8227-66452db3b27b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.789429] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fe142464-8b4e-4597-8227-66452db3b27b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.789513] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fe142464-8b4e-4597-8227-66452db3b27b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.789564] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fe142464-8b4e-4597-8227-66452db3b27b',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.831037] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7516d25f-7616-41dc-9575-16a9cddc1840: rpc.has_security_group_logging(os_id): False [ 1049.849333] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.849515] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.849646] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.849844] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.849961] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.850161] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.850288] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.850323] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.850493] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.850599] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.850821] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.850875] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.850956] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.851137] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.851238] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.851409] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.851512] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.851570] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.851715] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.851790] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.851890] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7516d25f-7616-41dc-9575-16a9cddc1840 is going to be created. [ 1049.878369] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('78a2df96-bab9-40fe-b845-1eec3b7d8df2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1049.930242] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1049.930513] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1049.930619] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1049.930837] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1049.931046] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1049.944190] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7516d25f-7616-41dc-9575-16a9cddc1840 in Status: IN_PROGRESS for 2s [ 1050.292420] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8c8bcd5f-7602-4632-8046-daa41c621837',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.295113] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c8bcd5f-7602-4632-8046-daa41c621837 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.295113] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c8bcd5f-7602-4632-8046-daa41c621837" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.295113] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fe142464-8b4e-4597-8227-66452db3b27b with status ACTIVE [ 1050.295113] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.295113] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.295494] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.296067] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.296067] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.297636] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.297636] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.297636] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.297636] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.297636] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.297636] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.297636] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.297636] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.297636] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.297636] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.297636] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fe142464-8b4e-4597-8227-66452db3b27b is going to be updated. [ 1050.322203] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.322582] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.322582] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.322753] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.322929] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.323127] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fe142464-8b4e-4597-8227-66452db3b27b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.381857] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('78a2df96-bab9-40fe-b845-1eec3b7d8df2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.802361] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8c8bcd5f-7602-4632-8046-daa41c621837',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1050.886595] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.886780] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.886859] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.887117] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.887224] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.887957] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78a2df96-bab9-40fe-b845-1eec3b7d8df2 is going to be updated. [ 1050.938860] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1050.939051] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1050.939051] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1050.939284] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1050.939445] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1050.950754] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78a2df96-bab9-40fe-b845-1eec3b7d8df2 in Status: IN_PROGRESS for 2s [ 1051.303771] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.303996] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.303996] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.304365] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.304365] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.304498] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c8bcd5f-7602-4632-8046-daa41c621837 is going to be created. [ 1051.328326] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1051.330799] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1051.330799] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1051.330799] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1051.330799] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1051.339356] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c8bcd5f-7602-4632-8046-daa41c621837 in Status: UNINITIALIZED for 2s [ 1051.959543] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7516d25f-7616-41dc-9575-16a9cddc1840 in Status: SUCCESS [ 1051.960023] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7516d25f-7616-41dc-9575-16a9cddc1840" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.018611] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78a2df96-bab9-40fe-b845-1eec3b7d8df2 in Status: SUCCESS [ 1053.018611] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.018949] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.018949] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.019106] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.019233] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.019301] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.019519] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.019666] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.019666] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.020020] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('78a2df96-bab9-40fe-b845-1eec3b7d8df2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.351435] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c8bcd5f-7602-4632-8046-daa41c621837 in Status: SUCCESS [ 1053.351709] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c8bcd5f-7602-4632-8046-daa41c621837" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.352273] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c8bcd5f-7602-4632-8046-daa41c621837" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.352395] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c8bcd5f-7602-4632-8046-daa41c621837" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.352581] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.352678] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.352772] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.352931] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.353651] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.353651] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c8bcd5f-7602-4632-8046-daa41c621837" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.353651] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8c8bcd5f-7602-4632-8046-daa41c621837',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.528021] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-78a2df96-bab9-40fe-b845-1eec3b7d8df2 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.528021] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.528021] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.528021] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.528021] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.528021] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.528021] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.528021] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.528021] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.528021] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.528021] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-78a2df96-bab9-40fe-b845-1eec3b7d8df2 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.528021] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.528021] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.528021] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.528662] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1053.528662] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1053.528662] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1053.528662] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1053.528662] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.528662] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1053.528662] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('78a2df96-bab9-40fe-b845-1eec3b7d8df2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1053.856058] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8c8bcd5f-7602-4632-8046-daa41c621837',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.032689] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 78a2df96-bab9-40fe-b845-1eec3b7d8df2: rpc.has_security_group_logging(os_id): False [ 1054.056215] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.056368] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.056465] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.056838] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.056838] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.056964] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.057049] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.057114] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.057293] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.057439] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.057581] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.058073] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.058143] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.058295] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.058370] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.058571] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.058668] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.058725] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.058867] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.058938] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.059607] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78a2df96-bab9-40fe-b845-1eec3b7d8df2 is going to be updated. [ 1054.102478] env[67094]: INFO networking_nsxv3.common.synchronization [None req-368daf5f-656c-4be7-8585-cd6c59ad42c2 None None] Enqueued Resource ID: 9cbb925a-d966-4090-9082-961c14f678e9 with Priority: HIGHEST for action port [ 1054.103030] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9cbb925a-d966-4090-9082-961c14f678e9 with Priority: HIGHEST for action port [ 1054.103387] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-9cbb925a-d966-4090-9082-961c14f678e9 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.103516] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9cbb925a-d966-4090-9082-961c14f678e9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.103596] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9cbb925a-d966-4090-9082-961c14f678e9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.104352] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9cbb925a-d966-4090-9082-961c14f678e9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.104566] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9cbb925a-d966-4090-9082-961c14f678e9',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1054.123915] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.123915] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.123915] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.124145] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.124181] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.136895] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78a2df96-bab9-40fe-b845-1eec3b7d8df2 in Status: IN_PROGRESS for 2s [ 1054.362102] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8c8bcd5f-7602-4632-8046-daa41c621837: rpc.has_security_group_logging(os_id): False [ 1054.382991] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.383163] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.383260] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.383454] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.383548] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.383799] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.383904] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.383967] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.384136] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.384263] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.384299] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c8bcd5f-7602-4632-8046-daa41c621837 is going to be created. [ 1054.477607] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.477791] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.478035] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.478298] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.478500] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.492022] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c8bcd5f-7602-4632-8046-daa41c621837 in Status: IN_PROGRESS for 2s [ 1054.607396] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 9cbb925a-d966-4090-9082-961c14f678e9 [ 1054.607646] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.607786] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.607877] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.608122] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.608226] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.608327] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:9cbb925a-d966-4090-9082-961c14f678e9 already deleted. [ 1054.608630] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9cbb925a-d966-4090-9082-961c14f678e9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1054.912301] env[67094]: INFO networking_nsxv3.common.synchronization [None req-7af3fc35-24df-4591-8304-01cee7c99441 tempest-AttachVolumeShelveTestJSON-2030912383 tempest-AttachVolumeShelveTestJSON-2030912383-project-member] Enqueued Resource ID: 78b18c8a-dfa7-43b1-860f-15a4c0e0a93f with Priority: HIGHEST for action security_group_rules [ 1054.912301] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78b18c8a-dfa7-43b1-860f-15a4c0e0a93f with Priority: HIGHEST for action security_group_rules [ 1054.912536] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78b18c8a-dfa7-43b1-860f-15a4c0e0a93f taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1054.912670] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78b18c8a-dfa7-43b1-860f-15a4c0e0a93f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1054.912737] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78b18c8a-dfa7-43b1-860f-15a4c0e0a93f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1054.913052] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78b18c8a-dfa7-43b1-860f-15a4c0e0a93f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1054.913144] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78b18c8a-dfa7-43b1-860f-15a4c0e0a93f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.040482] env[67094]: INFO networking_nsxv3.common.synchronization [None req-c7725364-e2f0-4258-b4ef-5eb2674ca2e3 tempest-AttachVolumeShelveTestJSON-2030912383 tempest-AttachVolumeShelveTestJSON-2030912383-project-member] Enqueued Resource ID: 78b18c8a-dfa7-43b1-860f-15a4c0e0a93f with Priority: HIGHEST for action security_group_rules [ 1055.041337] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78b18c8a-dfa7-43b1-860f-15a4c0e0a93f with Priority: HIGHEST for action security_group_rules [ 1055.042427] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78b18c8a-dfa7-43b1-860f-15a4c0e0a93f taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.042427] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78b18c8a-dfa7-43b1-860f-15a4c0e0a93f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.442246] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.442405] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.442469] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.442687] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.442776] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.443622] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78b18c8a-dfa7-43b1-860f-15a4c0e0a93f already deleted. [ 1055.443622] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78b18c8a-dfa7-43b1-860f-15a4c0e0a93f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.443622] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78b18c8a-dfa7-43b1-860f-15a4c0e0a93f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.443622] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78b18c8a-dfa7-43b1-860f-15a4c0e0a93f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.443622] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78b18c8a-dfa7-43b1-860f-15a4c0e0a93f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1055.967227] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1055.967227] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1055.967227] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1055.967227] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1055.967227] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1055.967227] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78b18c8a-dfa7-43b1-860f-15a4c0e0a93f already deleted. [ 1055.967227] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78b18c8a-dfa7-43b1-860f-15a4c0e0a93f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.105684] env[67094]: INFO networking_nsxv3.common.synchronization [req-e487466e-02a9-4277-9ccd-c16c1df1b364 req-991ab51b-c953-45a9-8e80-532a8c03f83f tempest-DeleteServersTestJSON-1237946437 tempest-DeleteServersTestJSON-1237946437-project-member] Enqueued Resource ID: 276c2084-ac8d-475a-af24-a062dc3e17aa with Priority: HIGHEST for action security_group_members [ 1056.106347] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 276c2084-ac8d-475a-af24-a062dc3e17aa with Priority: HIGHEST for action security_group_members [ 1056.106685] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-276c2084-ac8d-475a-af24-a062dc3e17aa taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.107277] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.107277] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.107277] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.107436] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.107491] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.107526] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.107773] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.107885] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.108024] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('276c2084-ac8d-475a-af24-a062dc3e17aa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.155421] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78a2df96-bab9-40fe-b845-1eec3b7d8df2 in Status: SUCCESS [ 1056.155560] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.155737] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.156011] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.156117] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78a2df96-bab9-40fe-b845-1eec3b7d8df2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.504981] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock network-318 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.505649] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "network-318" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.505649] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "network-318" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.505649] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "network-318" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.506507] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.506507] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.506507] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.506507] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.506507] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.507296] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1056.507296] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1056.507296] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1056.507296] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1056.507296] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1056.507296] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1056.507296] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1056.509045] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c8bcd5f-7602-4632-8046-daa41c621837 in Status: SUCCESS [ 1056.509324] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c8bcd5f-7602-4632-8046-daa41c621837" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.534303] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1056.534449] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1056.535202] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1056.535202] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "network-318" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.535202] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock port-3d51ae85-f0de-4665-b84d-b6649b6d188a taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.535444] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "port-3d51ae85-f0de-4665-b84d-b6649b6d188a" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.535444] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "port-3d51ae85-f0de-4665-b84d-b6649b6d188a" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.535806] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "port-3d51ae85-f0de-4665-b84d-b6649b6d188a" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.535948] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d51ae85-f0de-4665-b84d-b6649b6d188a',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.612874] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.612874] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.612874] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.613123] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.633965] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.634533] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.634533] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.634533] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.634752] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.634792] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.634975] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 276c2084-ac8d-475a-af24-a062dc3e17aa is going to be updated. [ 1056.658387] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-78a2df96-bab9-40fe-b845-1eec3b7d8df2 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.658595] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.658647] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.658829] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.659009] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.659120] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.659186] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.659342] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.659437] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.659601] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.659601] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('78a2df96-bab9-40fe-b845-1eec3b7d8df2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1056.663603] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.663777] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.663865] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.664029] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.664235] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1056.676061] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 276c2084-ac8d-475a-af24-a062dc3e17aa in Status: IN_PROGRESS for 2s [ 1056.835301] env[67094]: INFO networking_nsxv3.common.synchronization [None req-d0d1b66a-a36c-4fa6-aaa9-0a9268ecf283 None None] Enqueued Resource ID: 6e249ca2-46ee-4626-9d20-0c50565f05b1 with Priority: HIGHEST for action port [ 1056.835887] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6e249ca2-46ee-4626-9d20-0c50565f05b1 with Priority: HIGHEST for action port [ 1056.836296] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-6e249ca2-46ee-4626-9d20-0c50565f05b1 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1056.836404] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6e249ca2-46ee-4626-9d20-0c50565f05b1" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1056.836474] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6e249ca2-46ee-4626-9d20-0c50565f05b1" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1056.836748] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6e249ca2-46ee-4626-9d20-0c50565f05b1" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1056.836854] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6e249ca2-46ee-4626-9d20-0c50565f05b1',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.038896] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.039481] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.039481] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.039771] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.040061] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.040230] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Segment Port 3d51ae85-f0de-4665-b84d-b6649b6d188a not found, creating... [ 1057.040546] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.040719] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.040862] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.041141] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.041283] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.041620] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.041796] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.041964] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.042471] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.042611] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.043209] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Resource: SegmentPort with ID: 3d51ae85-f0de-4665-b84d-b6649b6d188a is going to be created. [ 1057.074010] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.074184] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.074325] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.074701] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.075047] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.075762] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "port-3d51ae85-f0de-4665-b84d-b6649b6d188a" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.162093] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-78a2df96-bab9-40fe-b845-1eec3b7d8df2 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.162594] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.162594] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.162817] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.163059] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.163210] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.163313] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.163533] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.163677] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.163808] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.164121] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-78a2df96-bab9-40fe-b845-1eec3b7d8df2 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.164236] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.164344] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.164564] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.164773] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.164919] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.165033] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.165304] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.165412] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.165561] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.165645] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('78a2df96-bab9-40fe-b845-1eec3b7d8df2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.339773] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port 6e249ca2-46ee-4626-9d20-0c50565f05b1 [ 1057.340102] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.340283] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.340381] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.340661] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.340783] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.340986] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:6e249ca2-46ee-4626-9d20-0c50565f05b1 already deleted. [ 1057.341123] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6e249ca2-46ee-4626-9d20-0c50565f05b1" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.668278] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 78a2df96-bab9-40fe-b845-1eec3b7d8df2: rpc.has_security_group_logging(os_id): False [ 1057.688390] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.688488] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.688569] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.688755] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.688848] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.689056] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.689180] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.689285] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.690097] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.690205] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.690433] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.690537] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.690603] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.690766] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.690842] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.691088] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.691207] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.691267] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.691435] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.691522] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.691613] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78a2df96-bab9-40fe-b845-1eec3b7d8df2 is going to be updated. [ 1057.695297] env[67094]: INFO networking_nsxv3.common.synchronization [req-428c6855-e6a1-4f46-8c5c-e3d2882f6ea6 req-63b11325-6a54-494a-9498-035c24acbeea tempest-ServerAddressesNegativeTestJSON-661804951 tempest-ServerAddressesNegativeTestJSON-661804951-project-member] Enqueued Resource ID: 7516d25f-7616-41dc-9575-16a9cddc1840 with Priority: HIGHEST for action security_group_members [ 1057.695781] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7516d25f-7616-41dc-9575-16a9cddc1840 with Priority: HIGHEST for action security_group_members [ 1057.696171] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-7516d25f-7616-41dc-9575-16a9cddc1840 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.696343] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7516d25f-7616-41dc-9575-16a9cddc1840" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.696429] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7516d25f-7616-41dc-9575-16a9cddc1840" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.696599] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7516d25f-7616-41dc-9575-16a9cddc1840" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.696753] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.696849] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.696916] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.697087] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.697200] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.697298] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7516d25f-7616-41dc-9575-16a9cddc1840',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.755694] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.755694] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.756018] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.756834] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.757160] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1057.770272] env[67094]: INFO networking_nsxv3.common.synchronization [req-e487466e-02a9-4277-9ccd-c16c1df1b364 req-746e91f3-a1b4-401c-b49d-f91c92467a2c service nova] Enqueued Resource ID: 276c2084-ac8d-475a-af24-a062dc3e17aa with Priority: HIGHEST for action security_group_rules [ 1057.770272] env[67094]: INFO networking_nsxv3.common.synchronization [req-e487466e-02a9-4277-9ccd-c16c1df1b364 req-746e91f3-a1b4-401c-b49d-f91c92467a2c service nova] Enqueued Resource ID: 276c2084-ac8d-475a-af24-a062dc3e17aa with Priority: HIGHEST for action security_group_members [ 1057.770272] env[67094]: INFO networking_nsxv3.common.synchronization [req-e487466e-02a9-4277-9ccd-c16c1df1b364 req-746e91f3-a1b4-401c-b49d-f91c92467a2c service nova] Enqueued Resource ID: 3d51ae85-f0de-4665-b84d-b6649b6d188a with Priority: HIGHEST for action port [ 1057.770272] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 276c2084-ac8d-475a-af24-a062dc3e17aa with Priority: HIGHEST for action security_group_rules [ 1057.770272] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 276c2084-ac8d-475a-af24-a062dc3e17aa with Priority: HIGHEST for action security_group_members [ 1057.770272] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3d51ae85-f0de-4665-b84d-b6649b6d188a with Priority: HIGHEST for action port [ 1057.772318] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-276c2084-ac8d-475a-af24-a062dc3e17aa taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.772318] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.772318] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.772318] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.772318] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('276c2084-ac8d-475a-af24-a062dc3e17aa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.772318] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-276c2084-ac8d-475a-af24-a062dc3e17aa taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.773026] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.773588] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-3d51ae85-f0de-4665-b84d-b6649b6d188a taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1057.773782] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3d51ae85-f0de-4665-b84d-b6649b6d188a" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1057.774388] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3d51ae85-f0de-4665-b84d-b6649b6d188a" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1057.774475] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3d51ae85-f0de-4665-b84d-b6649b6d188a" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1057.776851] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3d51ae85-f0de-4665-b84d-b6649b6d188a',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1057.776851] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78a2df96-bab9-40fe-b845-1eec3b7d8df2 in Status: IN_PROGRESS for 2s [ 1058.200051] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.200467] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.200467] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.200560] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.200614] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.200807] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.201013] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.201013] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.201165] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.201238] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.201328] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7516d25f-7616-41dc-9575-16a9cddc1840 is going to be updated. [ 1058.234292] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.234442] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.234537] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.234806] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.234958] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.246586] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7516d25f-7616-41dc-9575-16a9cddc1840 in Status: IN_PROGRESS for 2s [ 1058.277320] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-276c2084-ac8d-475a-af24-a062dc3e17aa taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.277320] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.279725] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3d51ae85-f0de-4665-b84d-b6649b6d188a with status ACTIVE [ 1058.279982] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.280134] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.280228] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.280458] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.280550] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.280775] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.280900] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.280974] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.281173] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.281253] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.281439] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.281534] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.281683] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.281744] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.281817] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.282549] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3d51ae85-f0de-4665-b84d-b6649b6d188a is going to be updated. [ 1058.317232] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.317401] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.317445] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.317696] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.317986] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.317986] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3d51ae85-f0de-4665-b84d-b6649b6d188a" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.686624] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 276c2084-ac8d-475a-af24-a062dc3e17aa in Status: SUCCESS [ 1058.686840] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 276c2084-ac8d-475a-af24-a062dc3e17aa deletion is rescheduled due to dependency. [ 1058.686958] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.687144] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.687354] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.687555] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1058.687672] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1058.687792] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1058.687945] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1058.688063] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1058.688183] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('276c2084-ac8d-475a-af24-a062dc3e17aa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.190628] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('276c2084-ac8d-475a-af24-a062dc3e17aa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.695135] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('276c2084-ac8d-475a-af24-a062dc3e17aa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1059.791522] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78a2df96-bab9-40fe-b845-1eec3b7d8df2 in Status: SUCCESS [ 1059.792044] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.196786] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.197040] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.197292] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.197352] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.197444] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.197577] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 276c2084-ac8d-475a-af24-a062dc3e17aa is going to be updated. [ 1060.231113] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1060.231344] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1060.231446] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1060.231721] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1060.231886] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1060.245470] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 276c2084-ac8d-475a-af24-a062dc3e17aa in Status: IN_PROGRESS for 2s [ 1060.256564] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7516d25f-7616-41dc-9575-16a9cddc1840 in Status: SUCCESS [ 1060.256762] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7516d25f-7616-41dc-9575-16a9cddc1840 deletion is rescheduled due to dependency. [ 1060.256882] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7516d25f-7616-41dc-9575-16a9cddc1840" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.256396] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 276c2084-ac8d-475a-af24-a062dc3e17aa in Status: SUCCESS [ 1062.256681] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.256854] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.257079] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.257274] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.257389] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.257454] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.257605] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.257735] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.257776] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.258037] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('276c2084-ac8d-475a-af24-a062dc3e17aa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.760489] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-276c2084-ac8d-475a-af24-a062dc3e17aa taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.760634] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.760729] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.760984] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.761209] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.761329] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.761452] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.761648] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.761719] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.761812] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.762104] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-276c2084-ac8d-475a-af24-a062dc3e17aa taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.762179] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.762179] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.762376] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.762657] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1062.762657] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1062.762657] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1062.762818] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1062.764248] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.764248] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1062.764248] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('276c2084-ac8d-475a-af24-a062dc3e17aa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1062.771079] env[67094]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1062.771236] env[67094]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1063.266504] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 276c2084-ac8d-475a-af24-a062dc3e17aa: rpc.has_security_group_logging(os_id): False [ 1063.285195] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.285340] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.285441] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.285610] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.285748] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.285998] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.286119] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.286182] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.286588] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.286674] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.286965] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.287086] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.287151] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.287289] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.287363] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.287541] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.287633] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.287691] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.287847] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.287983] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.288033] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 276c2084-ac8d-475a-af24-a062dc3e17aa is going to be updated. [ 1063.347962] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.348171] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.348327] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.349053] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.349053] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.362477] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 276c2084-ac8d-475a-af24-a062dc3e17aa in Status: IN_PROGRESS for 2s [ 1063.768913] env[67094]: INFO networking_nsxv3.common.synchronization [req-e82754aa-0540-424c-925b-1836f8b47e60 req-8de48d1e-bc9f-400f-a8e7-3f0f83dc6c41 tempest-ServersTestJSON-1070791530 tempest-ServersTestJSON-1070791530-project-member] Enqueued Resource ID: c0881101-1be1-4dbf-ac18-2d54a689202c with Priority: HIGHEST for action security_group_members [ 1063.769673] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0881101-1be1-4dbf-ac18-2d54a689202c with Priority: HIGHEST for action security_group_members [ 1063.770284] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0881101-1be1-4dbf-ac18-2d54a689202c taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.770424] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.770555] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.770843] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.771844] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1063.771844] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1063.771844] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1063.771844] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1063.771844] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1063.771844] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.162752] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock network-91 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.163034] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "network-91" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.163172] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "network-91" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.163498] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "network-91" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.163699] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.163848] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.163976] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.164207] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.164347] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.164551] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1064.164659] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1064.164763] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1064.164866] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1064.164967] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1064.165082] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1064.165213] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1064.185861] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1064.186060] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1064.186224] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1064.186400] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "network-91" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.186727] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock port-e529b406-1247-44a4-b62b-60d7e5864103 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.186898] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "port-e529b406-1247-44a4-b62b-60d7e5864103" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.187024] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "port-e529b406-1247-44a4-b62b-60d7e5864103" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.187357] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "port-e529b406-1247-44a4-b62b-60d7e5864103" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.187498] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e529b406-1247-44a4-b62b-60d7e5864103',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.275034] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1064.690289] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.690524] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.690721] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.690945] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.691138] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.691295] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Segment Port e529b406-1247-44a4-b62b-60d7e5864103 not found, creating... [ 1064.691576] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.691739] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.691854] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.692099] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.692286] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.692750] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.692944] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.693131] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.693296] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.693431] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.693569] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Resource: SegmentPort with ID: e529b406-1247-44a4-b62b-60d7e5864103 is going to be created. [ 1064.715826] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1064.716037] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1064.716188] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1064.716447] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1064.716681] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.716918] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "port-e529b406-1247-44a4-b62b-60d7e5864103" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1064.777702] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.280717] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.281085] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.281085] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.281309] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.281459] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.281551] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0881101-1be1-4dbf-ac18-2d54a689202c is going to be updated. [ 1065.310083] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.310263] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.310339] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.310544] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.310690] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.320457] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0881101-1be1-4dbf-ac18-2d54a689202c in Status: IN_PROGRESS for 2s [ 1065.375864] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 276c2084-ac8d-475a-af24-a062dc3e17aa in Status: SUCCESS [ 1065.376051] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.431897] env[67094]: INFO networking_nsxv3.common.synchronization [req-e82754aa-0540-424c-925b-1836f8b47e60 req-e57fe244-a0a5-4489-8c8c-c0f9d49fa71e service nova] Enqueued Resource ID: c0881101-1be1-4dbf-ac18-2d54a689202c with Priority: HIGHEST for action security_group_rules [ 1065.432141] env[67094]: INFO networking_nsxv3.common.synchronization [req-e82754aa-0540-424c-925b-1836f8b47e60 req-e57fe244-a0a5-4489-8c8c-c0f9d49fa71e service nova] Enqueued Resource ID: c0881101-1be1-4dbf-ac18-2d54a689202c with Priority: HIGHEST for action security_group_members [ 1065.432265] env[67094]: INFO networking_nsxv3.common.synchronization [req-e82754aa-0540-424c-925b-1836f8b47e60 req-e57fe244-a0a5-4489-8c8c-c0f9d49fa71e service nova] Enqueued Resource ID: e529b406-1247-44a4-b62b-60d7e5864103 with Priority: HIGHEST for action port [ 1065.432753] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0881101-1be1-4dbf-ac18-2d54a689202c with Priority: HIGHEST for action security_group_rules [ 1065.432888] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0881101-1be1-4dbf-ac18-2d54a689202c with Priority: HIGHEST for action security_group_members [ 1065.432995] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: e529b406-1247-44a4-b62b-60d7e5864103 with Priority: HIGHEST for action port [ 1065.433293] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c0881101-1be1-4dbf-ac18-2d54a689202c taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.433422] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.433519] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.433681] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.433764] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.434597] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0881101-1be1-4dbf-ac18-2d54a689202c taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.434837] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.434925] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-e529b406-1247-44a4-b62b-60d7e5864103 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.437256] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-e529b406-1247-44a4-b62b-60d7e5864103" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.437256] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-e529b406-1247-44a4-b62b-60d7e5864103" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.437256] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-e529b406-1247-44a4-b62b-60d7e5864103" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.437256] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('e529b406-1247-44a4-b62b-60d7e5864103',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.608607] env[67094]: INFO networking_nsxv3.common.synchronization [req-4b1f643f-d214-486b-a9c2-b9f29361d1f4 req-c23eb5bb-5c11-48d8-89b9-7518472f5411 tempest-ServerRescueNegativeTestJSON-389115858 tempest-ServerRescueNegativeTestJSON-389115858-project-member] Enqueued Resource ID: b61bfa2d-4c26-4a49-a153-4a8fb6153ccd with Priority: HIGHEST for action security_group_members [ 1065.609166] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b61bfa2d-4c26-4a49-a153-4a8fb6153ccd with Priority: HIGHEST for action security_group_members [ 1065.609466] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-b61bfa2d-4c26-4a49-a153-4a8fb6153ccd taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.609581] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b61bfa2d-4c26-4a49-a153-4a8fb6153ccd" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.609648] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b61bfa2d-4c26-4a49-a153-4a8fb6153ccd" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.609834] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b61bfa2d-4c26-4a49-a153-4a8fb6153ccd" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.610014] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.610119] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.610182] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.610328] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.610406] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.610494] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b61bfa2d-4c26-4a49-a153-4a8fb6153ccd',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1065.937461] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0881101-1be1-4dbf-ac18-2d54a689202c taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.938167] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.938452] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port e529b406-1247-44a4-b62b-60d7e5864103 with status ACTIVE [ 1065.938694] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.939067] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.939255] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.939570] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.939780] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.940149] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.940367] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.940492] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.940784] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.940932] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.941339] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.941772] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.941772] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.942047] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.942221] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.942423] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: e529b406-1247-44a4-b62b-60d7e5864103 is going to be updated. [ 1065.967410] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1065.968549] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1065.968549] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1065.968549] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1065.968549] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1065.968726] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-e529b406-1247-44a4-b62b-60d7e5864103" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.116276] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.118870] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.118870] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.118870] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.118870] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.118870] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.118870] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.118870] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.118870] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.118870] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.118870] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b61bfa2d-4c26-4a49-a153-4a8fb6153ccd is going to be updated. [ 1066.156239] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1066.156399] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1066.156490] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1066.156683] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1066.156927] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1066.168022] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b61bfa2d-4c26-4a49-a153-4a8fb6153ccd in Status: IN_PROGRESS for 2s [ 1067.333056] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0881101-1be1-4dbf-ac18-2d54a689202c in Status: SUCCESS [ 1067.333424] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.333662] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.333904] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.334199] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1067.334425] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1067.334485] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1067.334689] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1067.334814] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1067.334958] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1067.841178] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.179455] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b61bfa2d-4c26-4a49-a153-4a8fb6153ccd in Status: SUCCESS [ 1068.179641] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b61bfa2d-4c26-4a49-a153-4a8fb6153ccd deletion is rescheduled due to dependency. [ 1068.179748] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b61bfa2d-4c26-4a49-a153-4a8fb6153ccd" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.343869] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1068.846386] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.846547] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.846607] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.846826] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.846916] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.847092] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0881101-1be1-4dbf-ac18-2d54a689202c is going to be updated. [ 1068.880307] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1068.880492] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1068.880528] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1068.880709] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1068.880855] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1068.890345] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0881101-1be1-4dbf-ac18-2d54a689202c in Status: IN_PROGRESS for 2s [ 1070.565997] env[67094]: INFO networking_nsxv3.common.synchronization [req-cd9da136-7790-430b-9dc6-61f76b5c059a req-6a07025d-1965-4e53-8433-b42d87e5d97f tempest-ListServerFiltersTestJSON-1688651076 tempest-ListServerFiltersTestJSON-1688651076-project-member] Enqueued Resource ID: 78a2df96-bab9-40fe-b845-1eec3b7d8df2 with Priority: HIGHEST for action security_group_members [ 1070.566941] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78a2df96-bab9-40fe-b845-1eec3b7d8df2 with Priority: HIGHEST for action security_group_members [ 1070.567460] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-78a2df96-bab9-40fe-b845-1eec3b7d8df2 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.567658] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.567788] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.568115] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.568367] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.568534] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.568652] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.568916] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.569610] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.569610] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78a2df96-bab9-40fe-b845-1eec3b7d8df2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1070.906374] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0881101-1be1-4dbf-ac18-2d54a689202c in Status: SUCCESS [ 1070.906374] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.906486] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.906748] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.906970] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1070.907563] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1070.907563] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1070.907563] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1070.907563] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.907683] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1070.907777] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.072448] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('78a2df96-bab9-40fe-b845-1eec3b7d8df2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.115884] env[67094]: INFO networking_nsxv3.common.synchronization [req-a2646c31-1cda-44aa-a5b3-9eab9eec3fcd req-49e445d1-6299-4023-80fd-89a3c6a4e683 tempest-AttachVolumeShelveTestJSON-2030912383 tempest-AttachVolumeShelveTestJSON-2030912383-project-member] Enqueued Resource ID: 78b18c8a-dfa7-43b1-860f-15a4c0e0a93f with Priority: HIGHEST for action security_group_members [ 1071.116387] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78b18c8a-dfa7-43b1-860f-15a4c0e0a93f with Priority: HIGHEST for action security_group_members [ 1071.116726] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-78b18c8a-dfa7-43b1-860f-15a4c0e0a93f taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.116851] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78b18c8a-dfa7-43b1-860f-15a4c0e0a93f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.116917] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78b18c8a-dfa7-43b1-860f-15a4c0e0a93f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.117423] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78b18c8a-dfa7-43b1-860f-15a4c0e0a93f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.117567] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.117675] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.117830] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.117953] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.118098] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.118207] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78b18c8a-dfa7-43b1-860f-15a4c0e0a93f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.410589] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0881101-1be1-4dbf-ac18-2d54a689202c taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.410788] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.410894] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.411289] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.411848] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.412033] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.412138] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.412396] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.412460] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.412565] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.412724] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0881101-1be1-4dbf-ac18-2d54a689202c taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.412822] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.412884] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.413109] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.413252] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.413423] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.413423] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.413724] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.413845] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.413933] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.415207] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.575008] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('78a2df96-bab9-40fe-b845-1eec3b7d8df2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.604092] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock network-787 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.604208] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "network-787" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.604242] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "network-787" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.604580] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "network-787" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.604842] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.605014] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.605667] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.605915] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.606079] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.606323] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1071.606558] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1071.606588] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1071.606696] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1071.607190] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1071.607190] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1071.607190] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1071.620756] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.620756] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.620848] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.620982] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.621092] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.621399] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.621466] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.621545] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.621713] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.621810] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.621898] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78b18c8a-dfa7-43b1-860f-15a4c0e0a93f already deleted. [ 1071.621981] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78b18c8a-dfa7-43b1-860f-15a4c0e0a93f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.625727] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1071.625922] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1071.626049] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1071.626273] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "network-787" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.626617] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock port-9c81333c-a277-431f-aae5-2bdcc4b94edd taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.626792] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "port-9c81333c-a277-431f-aae5-2bdcc4b94edd" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.626913] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "port-9c81333c-a277-431f-aae5-2bdcc4b94edd" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.627272] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "port-9c81333c-a277-431f-aae5-2bdcc4b94edd" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.627437] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c81333c-a277-431f-aae5-2bdcc4b94edd',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1071.917745] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for c0881101-1be1-4dbf-ac18-2d54a689202c: rpc.has_security_group_logging(os_id): False [ 1071.937667] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.937921] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.937921] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.938209] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.958816] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.959170] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.959292] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.959811] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.959811] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.959811] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.959922] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.959995] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.960040] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.960681] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.960681] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.960681] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1071.960681] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1071.960681] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1071.960897] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1071.960897] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1071.960982] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c0881101-1be1-4dbf-ac18-2d54a689202c is going to be updated. [ 1072.035646] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.035646] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.035646] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.035646] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.035646] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.052769] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0881101-1be1-4dbf-ac18-2d54a689202c in Status: IN_PROGRESS for 2s [ 1072.077721] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.077951] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.078061] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.078281] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.078370] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.078468] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78a2df96-bab9-40fe-b845-1eec3b7d8df2 is going to be updated. [ 1072.113164] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.113325] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.113392] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.113604] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.113755] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.130511] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.130820] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.130998] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.131332] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.131719] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.131719] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Segment Port 9c81333c-a277-431f-aae5-2bdcc4b94edd not found, creating... [ 1072.131929] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.133198] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.133198] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.133198] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.133198] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.133198] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.133804] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.135849] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.136134] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.136284] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.136437] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Resource: SegmentPort with ID: 9c81333c-a277-431f-aae5-2bdcc4b94edd is going to be created. [ 1072.138360] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78a2df96-bab9-40fe-b845-1eec3b7d8df2 in Status: IN_PROGRESS for 2s [ 1072.176465] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.176714] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.176846] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.177126] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.177354] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.177584] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "port-9c81333c-a277-431f-aae5-2bdcc4b94edd" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.893641] env[67094]: INFO networking_nsxv3.common.synchronization [req-a2646c31-1cda-44aa-a5b3-9eab9eec3fcd req-d1152a12-b08e-45ac-b2f6-31b688b3735d service nova] Enqueued Resource ID: 78b18c8a-dfa7-43b1-860f-15a4c0e0a93f with Priority: HIGHEST for action security_group_rules [ 1072.893909] env[67094]: INFO networking_nsxv3.common.synchronization [req-a2646c31-1cda-44aa-a5b3-9eab9eec3fcd req-d1152a12-b08e-45ac-b2f6-31b688b3735d service nova] Enqueued Resource ID: 78b18c8a-dfa7-43b1-860f-15a4c0e0a93f with Priority: HIGHEST for action security_group_members [ 1072.893995] env[67094]: INFO networking_nsxv3.common.synchronization [req-a2646c31-1cda-44aa-a5b3-9eab9eec3fcd req-d1152a12-b08e-45ac-b2f6-31b688b3735d service nova] Enqueued Resource ID: 9c81333c-a277-431f-aae5-2bdcc4b94edd with Priority: HIGHEST for action port [ 1072.894625] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78b18c8a-dfa7-43b1-860f-15a4c0e0a93f with Priority: HIGHEST for action security_group_rules [ 1072.896820] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78b18c8a-dfa7-43b1-860f-15a4c0e0a93f with Priority: HIGHEST for action security_group_members [ 1072.896942] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c81333c-a277-431f-aae5-2bdcc4b94edd with Priority: HIGHEST for action port [ 1072.897278] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78b18c8a-dfa7-43b1-860f-15a4c0e0a93f taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.897420] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78b18c8a-dfa7-43b1-860f-15a4c0e0a93f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.897489] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78b18c8a-dfa7-43b1-860f-15a4c0e0a93f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.897741] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78b18c8a-dfa7-43b1-860f-15a4c0e0a93f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.897794] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78b18c8a-dfa7-43b1-860f-15a4c0e0a93f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.899973] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-78b18c8a-dfa7-43b1-860f-15a4c0e0a93f taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.899973] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78b18c8a-dfa7-43b1-860f-15a4c0e0a93f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.899973] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78b18c8a-dfa7-43b1-860f-15a4c0e0a93f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.899973] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78b18c8a-dfa7-43b1-860f-15a4c0e0a93f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.899973] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.899973] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.899973] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.899973] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.899973] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1072.900389] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78b18c8a-dfa7-43b1-860f-15a4c0e0a93f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1072.901466] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-9c81333c-a277-431f-aae5-2bdcc4b94edd taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1072.901466] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9c81333c-a277-431f-aae5-2bdcc4b94edd" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1072.901466] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9c81333c-a277-431f-aae5-2bdcc4b94edd" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1072.901466] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9c81333c-a277-431f-aae5-2bdcc4b94edd" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1072.901466] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c81333c-a277-431f-aae5-2bdcc4b94edd',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.405191] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('78b18c8a-dfa7-43b1-860f-15a4c0e0a93f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.405191] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-78b18c8a-dfa7-43b1-860f-15a4c0e0a93f taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.405191] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78b18c8a-dfa7-43b1-860f-15a4c0e0a93f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.405191] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9c81333c-a277-431f-aae5-2bdcc4b94edd with status ACTIVE [ 1073.405674] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.405674] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.405674] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.405674] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.405798] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.406023] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.406023] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.406105] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.406238] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.406325] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.410022] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.410022] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.410022] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.410022] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.410022] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.410022] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9c81333c-a277-431f-aae5-2bdcc4b94edd is going to be updated. [ 1073.434081] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.434081] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.434081] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.434081] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.434081] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.434081] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9c81333c-a277-431f-aae5-2bdcc4b94edd" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.794956] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock network-120 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.795182] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "network-120" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.795311] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "network-120" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.795576] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "network-120" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.795835] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.796253] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.796253] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.796338] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.796440] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.796684] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1073.796744] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1073.796856] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1073.796966] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1073.797089] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1073.797207] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1073.797338] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1073.818784] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1073.818985] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1073.819156] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1073.819335] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "network-120" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1073.819640] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock port-56955000-c206-4072-94ed-7f8bba9b22c7 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1073.819809] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "port-56955000-c206-4072-94ed-7f8bba9b22c7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1073.819928] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "port-56955000-c206-4072-94ed-7f8bba9b22c7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1073.820330] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "port-56955000-c206-4072-94ed-7f8bba9b22c7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1073.820416] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56955000-c206-4072-94ed-7f8bba9b22c7',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1073.910133] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('78b18c8a-dfa7-43b1-860f-15a4c0e0a93f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1074.070143] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: c0881101-1be1-4dbf-ac18-2d54a689202c in Status: SUCCESS [ 1074.070563] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.150514] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78a2df96-bab9-40fe-b845-1eec3b7d8df2 in Status: SUCCESS [ 1074.150821] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.323421] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.323625] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.323698] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.323988] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.324156] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.324459] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.324617] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.324741] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.324962] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.325113] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.325398] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.325616] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.325693] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.325868] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.325996] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.326154] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Resource: SegmentPort with ID: 56955000-c206-4072-94ed-7f8bba9b22c7 is going to be updated. [ 1074.349365] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.349578] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.349674] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.349950] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.350262] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.350552] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "port-56955000-c206-4072-94ed-7f8bba9b22c7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.411988] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.412248] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.412415] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.412803] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.412928] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.413080] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78b18c8a-dfa7-43b1-860f-15a4c0e0a93f is going to be created. [ 1074.452141] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1074.452270] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1074.452374] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1074.452699] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1074.452953] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1074.464178] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78b18c8a-dfa7-43b1-860f-15a4c0e0a93f in Status: UNINITIALIZED for 2s [ 1075.072366] env[67094]: INFO networking_nsxv3.common.synchronization [req-099a6901-6f3b-4366-9553-916c80edb208 req-1d0c4ea7-2176-4b1b-8ee5-186039d45987 service nova] Enqueued Resource ID: 280210af-8e3d-42c9-8854-42bd856b9dbe with Priority: HIGHEST for action security_group_rules [ 1075.072962] env[67094]: INFO networking_nsxv3.common.synchronization [req-099a6901-6f3b-4366-9553-916c80edb208 req-1d0c4ea7-2176-4b1b-8ee5-186039d45987 service nova] Enqueued Resource ID: 280210af-8e3d-42c9-8854-42bd856b9dbe with Priority: HIGHEST for action security_group_members [ 1075.072962] env[67094]: INFO networking_nsxv3.common.synchronization [req-099a6901-6f3b-4366-9553-916c80edb208 req-1d0c4ea7-2176-4b1b-8ee5-186039d45987 service nova] Enqueued Resource ID: 56955000-c206-4072-94ed-7f8bba9b22c7 with Priority: HIGHEST for action port [ 1075.073512] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 280210af-8e3d-42c9-8854-42bd856b9dbe with Priority: HIGHEST for action security_group_rules [ 1075.073663] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 280210af-8e3d-42c9-8854-42bd856b9dbe with Priority: HIGHEST for action security_group_members [ 1075.073834] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 56955000-c206-4072-94ed-7f8bba9b22c7 with Priority: HIGHEST for action port [ 1075.074601] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-280210af-8e3d-42c9-8854-42bd856b9dbe taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.074601] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.074601] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.074601] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.074846] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('280210af-8e3d-42c9-8854-42bd856b9dbe',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.076034] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-280210af-8e3d-42c9-8854-42bd856b9dbe taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.076170] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.076263] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.076443] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.076583] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.076730] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.076730] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.077660] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.077660] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.077660] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('280210af-8e3d-42c9-8854-42bd856b9dbe',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.078440] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-56955000-c206-4072-94ed-7f8bba9b22c7 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.078440] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-56955000-c206-4072-94ed-7f8bba9b22c7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.078440] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-56955000-c206-4072-94ed-7f8bba9b22c7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.078556] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-56955000-c206-4072-94ed-7f8bba9b22c7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.078670] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('56955000-c206-4072-94ed-7f8bba9b22c7',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.583056] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-280210af-8e3d-42c9-8854-42bd856b9dbe taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.583056] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.583056] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('280210af-8e3d-42c9-8854-42bd856b9dbe',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1075.583385] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 56955000-c206-4072-94ed-7f8bba9b22c7 with status ACTIVE [ 1075.583817] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.583817] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.583817] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.584046] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.584046] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.584443] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.584443] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.584443] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.584665] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.584722] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.584926] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.585073] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.585139] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.585573] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.585573] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.585573] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 56955000-c206-4072-94ed-7f8bba9b22c7 is going to be updated. [ 1075.611941] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.612340] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.612340] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.612479] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.612664] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.612770] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-56955000-c206-4072-94ed-7f8bba9b22c7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.654376] env[67094]: INFO networking_nsxv3.common.synchronization [req-5b67b366-ab89-4e86-9945-1e4524e09b3c req-f36f4aa1-4441-4436-8f92-bcab23beaf71 tempest-ServerActionsTestJSON-785713127 tempest-ServerActionsTestJSON-785713127-project-member] Enqueued Resource ID: 5d6b6e19-f017-4eac-b0ac-ed1b17230d12 with Priority: HIGHEST for action security_group_members [ 1075.655068] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d6b6e19-f017-4eac-b0ac-ed1b17230d12 with Priority: HIGHEST for action security_group_members [ 1075.655456] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-5d6b6e19-f017-4eac-b0ac-ed1b17230d12 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.655578] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-5d6b6e19-f017-4eac-b0ac-ed1b17230d12" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.655652] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-5d6b6e19-f017-4eac-b0ac-ed1b17230d12" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.656062] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-5d6b6e19-f017-4eac-b0ac-ed1b17230d12" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.656062] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1075.656182] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1075.656182] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1075.656475] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1075.656475] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1075.656475] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('5d6b6e19-f017-4eac-b0ac-ed1b17230d12',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.088920] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('280210af-8e3d-42c9-8854-42bd856b9dbe',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.162473] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.162675] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.162749] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.163484] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.163602] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.163827] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.163972] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.164022] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.164189] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.164277] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.164367] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d6b6e19-f017-4eac-b0ac-ed1b17230d12 is going to be updated. [ 1076.196132] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.196266] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.196342] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.196572] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.196722] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.209232] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d6b6e19-f017-4eac-b0ac-ed1b17230d12 in Status: IN_PROGRESS for 2s [ 1076.476587] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78b18c8a-dfa7-43b1-860f-15a4c0e0a93f in Status: SUCCESS [ 1076.476587] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78b18c8a-dfa7-43b1-860f-15a4c0e0a93f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.476587] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78b18c8a-dfa7-43b1-860f-15a4c0e0a93f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.476587] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78b18c8a-dfa7-43b1-860f-15a4c0e0a93f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.476587] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.476587] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.476587] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.476587] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.476587] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.476587] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78b18c8a-dfa7-43b1-860f-15a4c0e0a93f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.476587] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('78b18c8a-dfa7-43b1-860f-15a4c0e0a93f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.592801] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.595534] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.595534] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.595534] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.595534] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.595534] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 280210af-8e3d-42c9-8854-42bd856b9dbe is going to be updated. [ 1076.637131] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.637131] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.637131] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.637131] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.637131] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.650205] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 280210af-8e3d-42c9-8854-42bd856b9dbe in Status: IN_PROGRESS for 2s [ 1076.849280] env[67094]: INFO networking_nsxv3.common.synchronization [req-cabc488a-43be-4de3-9f1f-58f8b08dabf0 req-65903d3d-936f-4d01-a113-f6400f42d6e5 tempest-ServerActionsTestOtherB-1168296312 tempest-ServerActionsTestOtherB-1168296312-project-member] Enqueued Resource ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 with Priority: HIGHEST for action security_group_members [ 1076.849849] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 with Priority: HIGHEST for action security_group_members [ 1076.850385] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.850540] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.850601] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.850767] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.850927] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1076.851069] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1076.851151] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1076.851361] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1076.851483] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1076.851582] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1076.978976] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('78b18c8a-dfa7-43b1-860f-15a4c0e0a93f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.287725] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock network-78 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.287725] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "network-78" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.287725] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "network-78" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.287725] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "network-78" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.289736] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.289736] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.289736] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.289736] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.289736] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.289994] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1077.290058] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1077.290191] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1077.290300] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1077.290413] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1077.290518] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1077.291131] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1077.324639] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1077.324639] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Cache value generated in 0.034 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1077.325581] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1077.325581] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "network-78" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.325581] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock port-a474d68f-0d1e-4084-bfc7-39f9933b1e43 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.325581] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "port-a474d68f-0d1e-4084-bfc7-39f9933b1e43" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.325581] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "port-a474d68f-0d1e-4084-bfc7-39f9933b1e43" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.326011] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "port-a474d68f-0d1e-4084-bfc7-39f9933b1e43" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.326487] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a474d68f-0d1e-4084-bfc7-39f9933b1e43',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1077.356138] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.356892] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.357033] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.357213] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.357310] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.359675] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.359675] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.359675] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.359675] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.359675] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.359675] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 is going to be updated. [ 1077.397042] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.397475] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.397475] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.397708] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.397947] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.414165] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 in Status: IN_PROGRESS for 2s [ 1077.482773] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 78b18c8a-dfa7-43b1-860f-15a4c0e0a93f: rpc.has_security_group_logging(os_id): False [ 1077.508133] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.508365] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.508446] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.508671] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.508761] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.509044] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.509173] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.509271] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.509451] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.509546] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.509647] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78b18c8a-dfa7-43b1-860f-15a4c0e0a93f is going to be created. [ 1077.591103] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.591299] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.591340] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.591561] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.591744] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.603425] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78b18c8a-dfa7-43b1-860f-15a4c0e0a93f in Status: IN_PROGRESS for 2s [ 1077.830888] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.831297] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.831522] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.832051] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.832206] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.832486] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Segment Port a474d68f-0d1e-4084-bfc7-39f9933b1e43 not found, creating... [ 1077.832933] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.834168] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.834168] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.834168] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.834168] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.834560] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.834727] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.834926] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.835267] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.835425] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.835571] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Resource: SegmentPort with ID: a474d68f-0d1e-4084-bfc7-39f9933b1e43 is going to be created. [ 1077.858294] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1077.858558] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1077.858635] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1077.858891] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1077.859130] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1077.859351] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "port-a474d68f-0d1e-4084-bfc7-39f9933b1e43" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.219360] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 5d6b6e19-f017-4eac-b0ac-ed1b17230d12 in Status: SUCCESS [ 1078.219360] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 5d6b6e19-f017-4eac-b0ac-ed1b17230d12 deletion is rescheduled due to dependency. [ 1078.219360] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-5d6b6e19-f017-4eac-b0ac-ed1b17230d12" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.604172] env[67094]: INFO networking_nsxv3.common.synchronization [req-cabc488a-43be-4de3-9f1f-58f8b08dabf0 req-e20b29f9-d405-4e60-a0b9-d545ec9d9ddf service nova] Enqueued Resource ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 with Priority: HIGHEST for action security_group_rules [ 1078.604792] env[67094]: INFO networking_nsxv3.common.synchronization [req-cabc488a-43be-4de3-9f1f-58f8b08dabf0 req-e20b29f9-d405-4e60-a0b9-d545ec9d9ddf service nova] Enqueued Resource ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 with Priority: HIGHEST for action security_group_members [ 1078.604974] env[67094]: INFO networking_nsxv3.common.synchronization [req-cabc488a-43be-4de3-9f1f-58f8b08dabf0 req-e20b29f9-d405-4e60-a0b9-d545ec9d9ddf service nova] Enqueued Resource ID: a474d68f-0d1e-4084-bfc7-39f9933b1e43 with Priority: HIGHEST for action port [ 1078.606204] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 with Priority: HIGHEST for action security_group_rules [ 1078.606204] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 with Priority: HIGHEST for action security_group_members [ 1078.606204] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a474d68f-0d1e-4084-bfc7-39f9933b1e43 with Priority: HIGHEST for action port [ 1078.606204] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.606204] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.606386] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.606421] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.606554] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.607397] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.607537] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.607739] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-a474d68f-0d1e-4084-bfc7-39f9933b1e43 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.607840] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a474d68f-0d1e-4084-bfc7-39f9933b1e43" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.607934] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a474d68f-0d1e-4084-bfc7-39f9933b1e43" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.608114] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a474d68f-0d1e-4084-bfc7-39f9933b1e43" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.608750] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a474d68f-0d1e-4084-bfc7-39f9933b1e43',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1078.661898] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 280210af-8e3d-42c9-8854-42bd856b9dbe in Status: SUCCESS [ 1078.662157] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.662420] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.662645] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.662840] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1078.662956] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1078.663051] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1078.663209] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1078.663290] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.663376] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1078.663467] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('280210af-8e3d-42c9-8854-42bd856b9dbe',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.111767] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.111947] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.112128] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a474d68f-0d1e-4084-bfc7-39f9933b1e43 with status ACTIVE [ 1079.112304] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.112415] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.112481] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.113648] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.113648] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.113648] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.113648] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.113648] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.113648] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.113648] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.113648] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.113648] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.113648] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.114217] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.114217] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.114217] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a474d68f-0d1e-4084-bfc7-39f9933b1e43 is going to be updated. [ 1079.137876] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.138037] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.138037] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.138702] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.138702] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.138702] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a474d68f-0d1e-4084-bfc7-39f9933b1e43" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.169177] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-280210af-8e3d-42c9-8854-42bd856b9dbe taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.169177] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.169177] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.169177] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.169177] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.169177] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.169177] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.169177] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.169177] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.169177] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.169177] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-280210af-8e3d-42c9-8854-42bd856b9dbe taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.169177] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.169177] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.169177] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.169177] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.169177] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.169896] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.169896] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.169896] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.169896] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.169896] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('280210af-8e3d-42c9-8854-42bd856b9dbe',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.426884] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 in Status: SUCCESS [ 1079.426884] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 deletion is rescheduled due to dependency. [ 1079.426884] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.426884] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.426884] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.426884] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.426884] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.426884] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.426884] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.426884] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.426884] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.498077] env[67094]: INFO networking_nsxv3.common.synchronization [req-ac6a37c1-838f-474d-8048-14a520795025 req-fe67b6b5-6769-44ac-9ccb-71648064d123 tempest-AttachInterfacesTestJSON-1117082489 tempest-AttachInterfacesTestJSON-1117082489-project-member] Enqueued Resource ID: 8c8bcd5f-7602-4632-8046-daa41c621837 with Priority: HIGHEST for action security_group_members [ 1079.498685] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c8bcd5f-7602-4632-8046-daa41c621837 with Priority: HIGHEST for action security_group_members [ 1079.499156] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c8bcd5f-7602-4632-8046-daa41c621837 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.499291] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c8bcd5f-7602-4632-8046-daa41c621837" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.499358] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c8bcd5f-7602-4632-8046-daa41c621837" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.499557] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c8bcd5f-7602-4632-8046-daa41c621837" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.499712] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.499807] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.499869] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.500045] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.500139] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.500233] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c8bcd5f-7602-4632-8046-daa41c621837',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.618032] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78b18c8a-dfa7-43b1-860f-15a4c0e0a93f in Status: SUCCESS [ 1079.618032] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78b18c8a-dfa7-43b1-860f-15a4c0e0a93f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.672124] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 280210af-8e3d-42c9-8854-42bd856b9dbe: rpc.has_security_group_logging(os_id): False [ 1079.692825] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.692975] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.693052] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.693950] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.694053] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.694424] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.694562] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.694562] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.694720] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.694784] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.694974] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.695102] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.695160] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.695269] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.695339] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.695517] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.695628] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.695682] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.696121] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.696121] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.696121] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 280210af-8e3d-42c9-8854-42bd856b9dbe is going to be updated. [ 1079.793315] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.793315] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.793315] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.793621] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.793719] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.811358] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 280210af-8e3d-42c9-8854-42bd856b9dbe in Status: IN_PROGRESS for 2s [ 1079.846645] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock network-766 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.846886] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "network-766" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.847775] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "network-766" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.851022] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "network-766" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.851022] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.851022] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.851022] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.851022] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.851022] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.851022] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1079.851022] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1079.851022] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1079.851022] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1079.851022] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1079.851022] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1079.851022] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1079.873172] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1079.873491] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1079.873646] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1079.873824] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "network-766" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1079.874296] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock port-25234ce8-e82b-4fa4-a0c0-21e043f0ed1d taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1079.874487] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "port-25234ce8-e82b-4fa4-a0c0-21e043f0ed1d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1079.874606] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "port-25234ce8-e82b-4fa4-a0c0-21e043f0ed1d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1079.874952] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "port-25234ce8-e82b-4fa4-a0c0-21e043f0ed1d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1079.876738] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('25234ce8-e82b-4fa4-a0c0-21e043f0ed1d',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1079.928698] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.002645] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8c8bcd5f-7602-4632-8046-daa41c621837',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.378019] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.378303] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.378544] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.378796] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.378953] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.379190] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Segment Port 25234ce8-e82b-4fa4-a0c0-21e043f0ed1d not found, creating... [ 1080.379517] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.379745] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.379854] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.380273] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.380425] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.380944] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.381413] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.381581] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.381855] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.382017] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.382190] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Resource: SegmentPort with ID: 25234ce8-e82b-4fa4-a0c0-21e043f0ed1d is going to be created. [ 1080.406238] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.406496] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.406555] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.406881] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.407173] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.407473] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "port-25234ce8-e82b-4fa4-a0c0-21e043f0ed1d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.431447] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.505343] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8c8bcd5f-7602-4632-8046-daa41c621837',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1080.935468] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.935468] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.935468] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.935468] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.935468] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.935468] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 is going to be updated. [ 1080.978748] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1080.979024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1080.979149] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1080.979419] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1080.979638] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1080.999795] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 in Status: IN_PROGRESS for 2s [ 1081.010755] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.010755] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.010755] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.010755] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.010755] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.010755] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c8bcd5f-7602-4632-8046-daa41c621837 is going to be updated. [ 1081.050815] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.051116] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.051233] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.051618] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.051904] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.063091] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c8bcd5f-7602-4632-8046-daa41c621837 in Status: IN_PROGRESS for 2s [ 1081.263960] env[67094]: INFO networking_nsxv3.common.synchronization [req-ac6a37c1-838f-474d-8048-14a520795025 req-bc88c67b-7169-4e86-a24a-ae5d7e79c448 service nova] Enqueued Resource ID: 8c8bcd5f-7602-4632-8046-daa41c621837 with Priority: HIGHEST for action security_group_rules [ 1081.264179] env[67094]: INFO networking_nsxv3.common.synchronization [req-ac6a37c1-838f-474d-8048-14a520795025 req-bc88c67b-7169-4e86-a24a-ae5d7e79c448 service nova] Enqueued Resource ID: 8c8bcd5f-7602-4632-8046-daa41c621837 with Priority: HIGHEST for action security_group_members [ 1081.264317] env[67094]: INFO networking_nsxv3.common.synchronization [req-ac6a37c1-838f-474d-8048-14a520795025 req-bc88c67b-7169-4e86-a24a-ae5d7e79c448 service nova] Enqueued Resource ID: 25234ce8-e82b-4fa4-a0c0-21e043f0ed1d with Priority: HIGHEST for action port [ 1081.264934] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c8bcd5f-7602-4632-8046-daa41c621837 with Priority: HIGHEST for action security_group_rules [ 1081.265146] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c8bcd5f-7602-4632-8046-daa41c621837 with Priority: HIGHEST for action security_group_members [ 1081.265274] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 25234ce8-e82b-4fa4-a0c0-21e043f0ed1d with Priority: HIGHEST for action port [ 1081.265592] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c8bcd5f-7602-4632-8046-daa41c621837 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.265719] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c8bcd5f-7602-4632-8046-daa41c621837" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.265799] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c8bcd5f-7602-4632-8046-daa41c621837" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.266057] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c8bcd5f-7602-4632-8046-daa41c621837" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.266130] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c8bcd5f-7602-4632-8046-daa41c621837',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.267157] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c8bcd5f-7602-4632-8046-daa41c621837 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.267261] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c8bcd5f-7602-4632-8046-daa41c621837" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.267462] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-25234ce8-e82b-4fa4-a0c0-21e043f0ed1d taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.268576] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-25234ce8-e82b-4fa4-a0c0-21e043f0ed1d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.268576] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-25234ce8-e82b-4fa4-a0c0-21e043f0ed1d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.268576] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-25234ce8-e82b-4fa4-a0c0-21e043f0ed1d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.268576] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('25234ce8-e82b-4fa4-a0c0-21e043f0ed1d',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.498662] env[67094]: INFO networking_nsxv3.common.synchronization [req-edcfd8f0-b70d-4b80-9564-763049823efd req-73db5a07-2eba-4438-8148-b7502c814898 tempest-ServersTestJSON-1070791530 tempest-ServersTestJSON-1070791530-project-member] Enqueued Resource ID: c0881101-1be1-4dbf-ac18-2d54a689202c with Priority: HIGHEST for action security_group_members [ 1081.499469] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0881101-1be1-4dbf-ac18-2d54a689202c with Priority: HIGHEST for action security_group_members [ 1081.499877] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0881101-1be1-4dbf-ac18-2d54a689202c taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.499877] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.499991] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.501282] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.501282] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.501282] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.501282] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.501282] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.501282] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.501282] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1081.772354] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c8bcd5f-7602-4632-8046-daa41c621837 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.772558] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c8bcd5f-7602-4632-8046-daa41c621837" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.772787] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 25234ce8-e82b-4fa4-a0c0-21e043f0ed1d with status ACTIVE [ 1081.772937] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.773058] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.773136] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.773351] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.773389] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.773553] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.773650] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.773710] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.773878] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.773930] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.774135] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.774219] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.774275] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.774545] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.774641] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.774728] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 25234ce8-e82b-4fa4-a0c0-21e043f0ed1d is going to be updated. [ 1081.799459] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1081.799459] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1081.799459] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1081.799459] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1081.799459] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.799459] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-25234ce8-e82b-4fa4-a0c0-21e043f0ed1d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1081.827508] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 280210af-8e3d-42c9-8854-42bd856b9dbe in Status: SUCCESS [ 1081.827508] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.007607] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.099017] env[67094]: INFO networking_nsxv3.common.synchronization [req-cb551a6d-0b55-414f-b5a3-cf169d633848 req-83eea134-4b5b-425b-aafa-9fd213f37abf tempest-ServersTestBootFromVolume-467953286 tempest-ServersTestBootFromVolume-467953286-project-member] Enqueued Resource ID: 7d339cc8-3c0d-42f5-b975-687230de264b with Priority: HIGHEST for action security_group_members [ 1082.102549] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d339cc8-3c0d-42f5-b975-687230de264b with Priority: HIGHEST for action security_group_members [ 1082.102549] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d339cc8-3c0d-42f5-b975-687230de264b taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.102549] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d339cc8-3c0d-42f5-b975-687230de264b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.102549] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d339cc8-3c0d-42f5-b975-687230de264b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.102549] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d339cc8-3c0d-42f5-b975-687230de264b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.102549] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.102549] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.102549] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.102549] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.102549] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.102549] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d339cc8-3c0d-42f5-b975-687230de264b',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.512907] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock network-959 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.512907] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "network-959" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.512907] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "network-959" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.512907] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "network-959" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.514518] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.514518] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.514518] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.514518] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.514518] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.514518] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1082.514728] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1082.514728] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1082.514779] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1082.514913] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1082.514970] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1082.515177] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1082.516436] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.539924] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1082.540109] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1082.540413] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1082.540637] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "network-959" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.540973] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock port-a2b60f2c-ee9c-4230-bdc3-382df5665bc7 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.541264] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "port-a2b60f2c-ee9c-4230-bdc3-382df5665bc7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.541387] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "port-a2b60f2c-ee9c-4230-bdc3-382df5665bc7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.541711] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "port-a2b60f2c-ee9c-4230-bdc3-382df5665bc7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.541853] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2b60f2c-ee9c-4230-bdc3-382df5665bc7',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1082.605815] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.606173] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.606301] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.606557] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.606663] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.606907] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1082.607085] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1082.607168] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1082.607368] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1082.607457] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1082.607560] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d339cc8-3c0d-42f5-b975-687230de264b already deleted. [ 1082.607660] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d339cc8-3c0d-42f5-b975-687230de264b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.014354] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 in Status: SUCCESS [ 1083.014354] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.014354] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.014354] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.014354] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.014354] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.014354] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.014354] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.014354] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.014354] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.014354] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.019155] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.019321] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.019394] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.019761] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.019966] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.020125] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0881101-1be1-4dbf-ac18-2d54a689202c is going to be updated. [ 1083.046221] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.046570] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.046768] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.047580] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.047824] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.048030] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Segment Port a2b60f2c-ee9c-4230-bdc3-382df5665bc7 not found, creating... [ 1083.048394] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.048643] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.048786] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.049119] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.049272] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.049726] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.049933] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.050123] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.050361] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.050545] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.050707] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Resource: SegmentPort with ID: a2b60f2c-ee9c-4230-bdc3-382df5665bc7 is going to be created. [ 1083.056157] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.056291] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.056356] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.056568] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.056795] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.082173] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0881101-1be1-4dbf-ac18-2d54a689202c in Status: IN_PROGRESS for 2s [ 1083.083098] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c8bcd5f-7602-4632-8046-daa41c621837 in Status: SUCCESS [ 1083.083342] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c8bcd5f-7602-4632-8046-daa41c621837" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.083918] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c8bcd5f-7602-4632-8046-daa41c621837" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.084170] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c8bcd5f-7602-4632-8046-daa41c621837" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.084391] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.084516] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.084589] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.084787] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.084876] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.084992] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c8bcd5f-7602-4632-8046-daa41c621837',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.105539] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.105925] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.106190] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.106522] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.106816] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.107152] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "port-a2b60f2c-ee9c-4230-bdc3-382df5665bc7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.515896] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.587785] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8c8bcd5f-7602-4632-8046-daa41c621837',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.823041] env[67094]: INFO networking_nsxv3.common.synchronization [req-cb551a6d-0b55-414f-b5a3-cf169d633848 req-b4aba31a-8c4c-4ff8-82be-e1cdd6189fba service nova] Enqueued Resource ID: 7d339cc8-3c0d-42f5-b975-687230de264b with Priority: HIGHEST for action security_group_rules [ 1083.823041] env[67094]: INFO networking_nsxv3.common.synchronization [req-cb551a6d-0b55-414f-b5a3-cf169d633848 req-b4aba31a-8c4c-4ff8-82be-e1cdd6189fba service nova] Enqueued Resource ID: 7d339cc8-3c0d-42f5-b975-687230de264b with Priority: HIGHEST for action security_group_members [ 1083.823041] env[67094]: INFO networking_nsxv3.common.synchronization [req-cb551a6d-0b55-414f-b5a3-cf169d633848 req-b4aba31a-8c4c-4ff8-82be-e1cdd6189fba service nova] Enqueued Resource ID: a2b60f2c-ee9c-4230-bdc3-382df5665bc7 with Priority: HIGHEST for action port [ 1083.823546] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d339cc8-3c0d-42f5-b975-687230de264b with Priority: HIGHEST for action security_group_rules [ 1083.823690] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d339cc8-3c0d-42f5-b975-687230de264b with Priority: HIGHEST for action security_group_members [ 1083.823788] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a2b60f2c-ee9c-4230-bdc3-382df5665bc7 with Priority: HIGHEST for action port [ 1083.824092] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7d339cc8-3c0d-42f5-b975-687230de264b taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.824219] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7d339cc8-3c0d-42f5-b975-687230de264b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.824287] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7d339cc8-3c0d-42f5-b975-687230de264b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.824493] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7d339cc8-3c0d-42f5-b975-687230de264b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.824579] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7d339cc8-3c0d-42f5-b975-687230de264b',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.825490] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d339cc8-3c0d-42f5-b975-687230de264b taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.825610] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d339cc8-3c0d-42f5-b975-687230de264b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.825680] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d339cc8-3c0d-42f5-b975-687230de264b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.825864] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d339cc8-3c0d-42f5-b975-687230de264b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.826020] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.826118] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.826178] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.826411] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.826411] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1083.826494] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d339cc8-3c0d-42f5-b975-687230de264b',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1083.828924] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-a2b60f2c-ee9c-4230-bdc3-382df5665bc7 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1083.828924] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-a2b60f2c-ee9c-4230-bdc3-382df5665bc7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1083.828924] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-a2b60f2c-ee9c-4230-bdc3-382df5665bc7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1083.828924] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-a2b60f2c-ee9c-4230-bdc3-382df5665bc7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1083.829109] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('a2b60f2c-ee9c-4230-bdc3-382df5665bc7',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.026259] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9: rpc.has_security_group_logging(os_id): False [ 1084.040186] env[67094]: INFO networking_nsxv3.common.synchronization [req-e683b44c-1802-4ab5-9ed8-13fd9f57bdfd req-3748de5c-ca83-4851-8a2b-6cff5783ad6f tempest-DeleteServersTestJSON-1237946437 tempest-DeleteServersTestJSON-1237946437-project-member] Enqueued Resource ID: 276c2084-ac8d-475a-af24-a062dc3e17aa with Priority: HIGHEST for action security_group_members [ 1084.043924] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 276c2084-ac8d-475a-af24-a062dc3e17aa with Priority: HIGHEST for action security_group_members [ 1084.043924] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-276c2084-ac8d-475a-af24-a062dc3e17aa taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.043924] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.043924] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.045239] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.045456] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.045579] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.045643] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.045860] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.045926] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.046067] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('276c2084-ac8d-475a-af24-a062dc3e17aa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.048537] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.048689] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.048741] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.049918] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.049918] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.049918] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.049918] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.049918] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.050263] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.050263] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.050263] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 is going to be updated. [ 1084.090222] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8c8bcd5f-7602-4632-8046-daa41c621837',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.124561] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.124785] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.124921] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.128026] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.128026] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.171172] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 in Status: IN_PROGRESS for 2s [ 1084.331599] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d339cc8-3c0d-42f5-b975-687230de264b taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.331782] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d339cc8-3c0d-42f5-b975-687230de264b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.331933] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('7d339cc8-3c0d-42f5-b975-687230de264b',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1084.333051] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port a2b60f2c-ee9c-4230-bdc3-382df5665bc7 with status ACTIVE [ 1084.333291] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.333385] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.333445] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.333702] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.333799] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.333978] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.334927] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.335534] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.335534] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.335534] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.335534] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.335766] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.335766] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.335845] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.335845] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.335944] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: a2b60f2c-ee9c-4230-bdc3-382df5665bc7 is going to be updated. [ 1084.361454] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.361633] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.361672] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.361928] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.362111] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.362278] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-a2b60f2c-ee9c-4230-bdc3-382df5665bc7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.556028] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.556028] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.556028] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.556028] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.556028] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.556028] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.556028] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.556028] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.556028] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.556028] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.556028] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 276c2084-ac8d-475a-af24-a062dc3e17aa is going to be updated. [ 1084.595434] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.595665] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.595711] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.596047] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.596179] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.596406] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c8bcd5f-7602-4632-8046-daa41c621837 is going to be updated. [ 1084.598836] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.599094] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.599094] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.601131] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.601131] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.611564] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 276c2084-ac8d-475a-af24-a062dc3e17aa in Status: IN_PROGRESS for 2s [ 1084.631272] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1084.632972] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1084.632972] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1084.632972] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1084.632972] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1084.645551] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c8bcd5f-7602-4632-8046-daa41c621837 in Status: IN_PROGRESS for 2s [ 1084.838212] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('7d339cc8-3c0d-42f5-b975-687230de264b',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1085.098492] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0881101-1be1-4dbf-ac18-2d54a689202c in Status: SUCCESS [ 1085.098492] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.341777] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.342061] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.342061] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.342379] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.342532] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.342694] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d339cc8-3c0d-42f5-b975-687230de264b is going to be created. [ 1085.369109] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1085.369258] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1085.369330] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1085.369549] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1085.369758] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1085.383108] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d339cc8-3c0d-42f5-b975-687230de264b in Status: UNINITIALIZED for 2s [ 1086.192292] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 in Status: SUCCESS [ 1086.192292] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.211349] env[67094]: INFO networking_nsxv3.common.synchronization [req-9bbc5437-9fcc-4c0e-9c9c-ae8a507ed64d req-54b96f1b-36e4-431e-ba46-8b5370c343fb tempest-ServersV294TestFqdnHostnames-2045593341 tempest-ServersV294TestFqdnHostnames-2045593341-project-member] Enqueued Resource ID: 3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56 with Priority: HIGHEST for action security_group_members [ 1086.212190] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56 with Priority: HIGHEST for action security_group_members [ 1086.212611] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.213081] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.213081] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.213081] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.213278] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.213407] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.213474] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.213647] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.213774] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.213945] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.623234] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 276c2084-ac8d-475a-af24-a062dc3e17aa in Status: SUCCESS [ 1086.623409] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 276c2084-ac8d-475a-af24-a062dc3e17aa deletion is rescheduled due to dependency. [ 1086.623688] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.657024] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c8bcd5f-7602-4632-8046-daa41c621837 in Status: SUCCESS [ 1086.657024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c8bcd5f-7602-4632-8046-daa41c621837" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.657024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c8bcd5f-7602-4632-8046-daa41c621837" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.657024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c8bcd5f-7602-4632-8046-daa41c621837" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.657024] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.657024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.657024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.657024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.657024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.657024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c8bcd5f-7602-4632-8046-daa41c621837" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.657024] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8c8bcd5f-7602-4632-8046-daa41c621837',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1086.718832] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.718832] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.718832] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.718832] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.718832] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.718832] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.718832] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.718832] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.718832] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.718832] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.718832] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56 is going to be updated. [ 1086.756621] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1086.756790] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1086.756790] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1086.756942] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1086.757100] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1086.767453] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56 in Status: IN_PROGRESS for 2s [ 1087.160100] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8c8bcd5f-7602-4632-8046-daa41c621837',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.396571] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d339cc8-3c0d-42f5-b975-687230de264b in Status: SUCCESS [ 1087.396985] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d339cc8-3c0d-42f5-b975-687230de264b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.397044] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d339cc8-3c0d-42f5-b975-687230de264b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.397255] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d339cc8-3c0d-42f5-b975-687230de264b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.397459] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.397576] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.397641] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.397790] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.397870] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.397964] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d339cc8-3c0d-42f5-b975-687230de264b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.398058] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('7d339cc8-3c0d-42f5-b975-687230de264b',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1087.663222] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8c8bcd5f-7602-4632-8046-daa41c621837: rpc.has_security_group_logging(os_id): False [ 1087.692997] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.693223] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.693325] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.693619] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.693733] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.694069] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.694242] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.694436] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.694694] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.694844] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.695052] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c8bcd5f-7602-4632-8046-daa41c621837 is going to be updated. [ 1087.763822] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1087.764060] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1087.764060] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1087.764280] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1087.764448] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1087.780637] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c8bcd5f-7602-4632-8046-daa41c621837 in Status: IN_PROGRESS for 2s [ 1087.900936] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('7d339cc8-3c0d-42f5-b975-687230de264b',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1088.407355] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 7d339cc8-3c0d-42f5-b975-687230de264b: rpc.has_security_group_logging(os_id): False [ 1088.433123] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.433372] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.433461] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.433707] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.433823] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.434228] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.434356] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.434417] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.434662] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.434733] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.435196] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7d339cc8-3c0d-42f5-b975-687230de264b is going to be created. [ 1088.517428] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1088.517623] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1088.517666] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1088.517862] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1088.518206] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1088.534216] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d339cc8-3c0d-42f5-b975-687230de264b in Status: IN_PROGRESS for 2s [ 1088.787228] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56 in Status: SUCCESS [ 1088.787228] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56 deletion is rescheduled due to dependency. [ 1088.787228] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1089.798830] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8c8bcd5f-7602-4632-8046-daa41c621837 in Status: SUCCESS [ 1089.799170] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c8bcd5f-7602-4632-8046-daa41c621837" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.171868] env[67094]: INFO networking_nsxv3.common.synchronization [req-f531e2e5-3e6b-4112-bd17-a42c02049e50 req-9709efdb-9bf9-4c54-9f6f-f5f5aeaa7295 tempest-ListServerFiltersTestJSON-1688651076 tempest-ListServerFiltersTestJSON-1688651076-project-member] Enqueued Resource ID: 78a2df96-bab9-40fe-b845-1eec3b7d8df2 with Priority: HIGHEST for action security_group_members [ 1090.173034] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78a2df96-bab9-40fe-b845-1eec3b7d8df2 with Priority: HIGHEST for action security_group_members [ 1090.173034] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-78a2df96-bab9-40fe-b845-1eec3b7d8df2 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.173034] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.173034] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.173287] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.173448] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1090.173512] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1090.173604] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1090.173769] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1090.174415] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.174415] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78a2df96-bab9-40fe-b845-1eec3b7d8df2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1090.548677] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 7d339cc8-3c0d-42f5-b975-687230de264b in Status: SUCCESS [ 1090.549131] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7d339cc8-3c0d-42f5-b975-687230de264b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1090.676376] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('78a2df96-bab9-40fe-b845-1eec3b7d8df2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.179321] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('78a2df96-bab9-40fe-b845-1eec3b7d8df2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1091.681689] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.682898] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.683048] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.683355] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.685797] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.685797] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78a2df96-bab9-40fe-b845-1eec3b7d8df2 is going to be updated. [ 1091.743398] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1091.743679] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1091.743753] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1091.745302] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1091.745302] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1091.757893] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78a2df96-bab9-40fe-b845-1eec3b7d8df2 in Status: IN_PROGRESS for 2s [ 1092.103018] env[67094]: INFO networking_nsxv3.common.synchronization [None req-ce2139d5-1a76-46e6-af97-7b7375e4657a tempest-AttachInterfacesTestJSON-1117082489 tempest-AttachInterfacesTestJSON-1117082489-project-member] Enqueued Resource ID: 882c69d3-9554-45c6-97a1-55fb0f065040 with Priority: HIGHEST for action security_group_members [ 1092.105031] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 882c69d3-9554-45c6-97a1-55fb0f065040 with Priority: HIGHEST for action security_group_members [ 1092.105422] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-882c69d3-9554-45c6-97a1-55fb0f065040 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.105551] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.105616] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.105821] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.105993] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.106084] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.106157] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.106284] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.106388] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.106483] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('882c69d3-9554-45c6-97a1-55fb0f065040',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.123141] env[67094]: INFO networking_nsxv3.common.synchronization [req-1bc1b96c-663a-48b5-b51d-84d7a8e9eaca req-d7d26e4e-0088-48fb-ac91-8cf3fb15c298 tempest-ServerDiskConfigTestJSON-51233165 tempest-ServerDiskConfigTestJSON-51233165-project-member] Enqueued Resource ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 with Priority: HIGHEST for action security_group_members [ 1092.123852] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 with Priority: HIGHEST for action security_group_members [ 1092.124697] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.124854] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.125218] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.125218] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.129053] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.129053] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.129053] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.129053] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.129053] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.129053] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.407211] env[67094]: INFO networking_nsxv3.common.synchronization [req-bf2e705e-cdf3-44ab-8159-5ad06623424b req-a620d05b-21df-49af-a7ff-937a724336c5 tempest-ServerRescueNegativeTestJSON-389115858 tempest-ServerRescueNegativeTestJSON-389115858-project-member] Enqueued Resource ID: 34b6178d-c850-4655-81a1-f452d6a6f576 with Priority: HIGHEST for action security_group_members [ 1092.407211] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34b6178d-c850-4655-81a1-f452d6a6f576 with Priority: HIGHEST for action security_group_members [ 1092.407211] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-34b6178d-c850-4655-81a1-f452d6a6f576 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.407211] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34b6178d-c850-4655-81a1-f452d6a6f576" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.407211] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34b6178d-c850-4655-81a1-f452d6a6f576" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.407848] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34b6178d-c850-4655-81a1-f452d6a6f576" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.408146] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.408430] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.408614] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.408916] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.409154] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.409379] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34b6178d-c850-4655-81a1-f452d6a6f576',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1092.612293] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.612506] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.612610] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.612936] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.628055] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.628304] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.640854] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.640854] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.640854] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.640854] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.640854] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.640854] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.640854] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 882c69d3-9554-45c6-97a1-55fb0f065040 is going to be updated. [ 1092.640854] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.640854] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.662504] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.662775] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.663030] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.663030] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.663279] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.663392] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.663672] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 is going to be updated. [ 1092.673232] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.673380] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.673454] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.673666] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.673818] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.685550] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882c69d3-9554-45c6-97a1-55fb0f065040 in Status: IN_PROGRESS for 2s [ 1092.697555] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1092.697555] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1092.697555] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1092.697555] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1092.697555] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1092.707577] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 in Status: IN_PROGRESS for 2s [ 1092.912858] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('34b6178d-c850-4655-81a1-f452d6a6f576',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.415690] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('34b6178d-c850-4655-81a1-f452d6a6f576',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1093.778225] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78a2df96-bab9-40fe-b845-1eec3b7d8df2 in Status: SUCCESS [ 1093.778550] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.918467] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.918621] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.918702] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.918932] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.919041] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.919305] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34b6178d-c850-4655-81a1-f452d6a6f576 is going to be updated. [ 1093.956895] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1093.957555] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1093.957555] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1093.957555] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1093.957555] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1093.967498] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34b6178d-c850-4655-81a1-f452d6a6f576 in Status: IN_PROGRESS for 2s [ 1094.696291] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882c69d3-9554-45c6-97a1-55fb0f065040 in Status: SUCCESS [ 1094.696678] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 882c69d3-9554-45c6-97a1-55fb0f065040 deletion is rescheduled due to dependency. [ 1094.696678] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1094.718645] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 in Status: SUCCESS [ 1094.718645] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 deletion is rescheduled due to dependency. [ 1094.718645] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1095.980094] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34b6178d-c850-4655-81a1-f452d6a6f576 in Status: SUCCESS [ 1095.980562] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34b6178d-c850-4655-81a1-f452d6a6f576" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1097.407390] env[67094]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1097.407681] env[67094]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1100.793661] env[67094]: INFO networking_nsxv3.common.synchronization [req-dcab7ad8-d7eb-4014-8092-21b0b6430de6 req-37bf24f7-69ae-4905-8f39-3d6cad755932 tempest-ServersTestJSON-1070791530 tempest-ServersTestJSON-1070791530-project-member] Enqueued Resource ID: c0881101-1be1-4dbf-ac18-2d54a689202c with Priority: HIGHEST for action security_group_members [ 1100.794228] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c0881101-1be1-4dbf-ac18-2d54a689202c with Priority: HIGHEST for action security_group_members [ 1100.794580] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-c0881101-1be1-4dbf-ac18-2d54a689202c taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.794724] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.794797] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.794994] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.795233] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1100.795335] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1100.795397] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1100.795562] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1100.795647] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1100.795744] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('c0881101-1be1-4dbf-ac18-2d54a689202c',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1101.298032] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.298261] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.298334] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.298553] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.298644] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.298848] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.298942] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.299012] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.299203] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.299249] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.299311] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0881101-1be1-4dbf-ac18-2d54a689202c is going to be updated. [ 1101.340843] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1101.341141] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1101.341141] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1101.341362] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1101.341477] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1101.356323] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0881101-1be1-4dbf-ac18-2d54a689202c in Status: IN_PROGRESS for 2s [ 1103.368663] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: c0881101-1be1-4dbf-ac18-2d54a689202c in Status: SUCCESS [ 1103.368663] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: c0881101-1be1-4dbf-ac18-2d54a689202c deletion is rescheduled due to dependency. [ 1103.369110] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-c0881101-1be1-4dbf-ac18-2d54a689202c" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1105.795704] env[67094]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1105.795704] env[67094]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1106.860412] env[67094]: INFO networking_nsxv3.common.synchronization [req-f0cab6a0-8cf3-45f6-ad5f-fc4702c77756 req-73ad7f11-a4da-4262-9ce3-8f5a65b98954 tempest-ListServerFiltersTestJSON-1688651076 tempest-ListServerFiltersTestJSON-1688651076-project-member] Enqueued Resource ID: 78a2df96-bab9-40fe-b845-1eec3b7d8df2 with Priority: HIGHEST for action security_group_members [ 1106.860626] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78a2df96-bab9-40fe-b845-1eec3b7d8df2 with Priority: HIGHEST for action security_group_members [ 1106.861250] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-78a2df96-bab9-40fe-b845-1eec3b7d8df2 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.861396] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.861470] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.861664] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.861820] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1106.861918] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1106.861975] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1106.862140] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1106.862227] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1106.862319] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78a2df96-bab9-40fe-b845-1eec3b7d8df2',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.364129] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.365124] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.365124] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.365124] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.365124] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.365124] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.365124] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.365124] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.365439] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.365439] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.365439] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78a2df96-bab9-40fe-b845-1eec3b7d8df2 is going to be updated. [ 1107.399547] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.400060] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.400566] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.400898] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.401171] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.412114] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78a2df96-bab9-40fe-b845-1eec3b7d8df2 in Status: IN_PROGRESS for 2s [ 1107.523048] env[67094]: INFO networking_nsxv3.common.synchronization [req-5868eb41-95e0-4f61-ad0c-df737bdf9c79 req-68732c66-be34-47d9-8395-7c91e0a9545a tempest-ServerDiskConfigTestJSON-51233165 tempest-ServerDiskConfigTestJSON-51233165-project-member] Enqueued Resource ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 with Priority: HIGHEST for action security_group_members [ 1107.523719] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 with Priority: HIGHEST for action security_group_members [ 1107.524532] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.524734] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.524824] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.525129] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.525353] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.525478] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.525549] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.526032] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.526149] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.526270] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1107.866628] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock network-723 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.866952] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "network-723" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.866952] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "network-723" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.867955] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "network-723" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.867955] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.870017] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.870017] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.870017] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.870017] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.870017] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1107.870017] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1107.870017] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1107.870017] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1107.870017] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1107.870017] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1107.870017] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1107.893506] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1107.893506] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1107.893506] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1107.893672] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "network-723" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1107.893941] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock port-17efb6ad-6e1b-4dee-a159-6842b93cd378 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1107.894953] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "port-17efb6ad-6e1b-4dee-a159-6842b93cd378" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1107.894953] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "port-17efb6ad-6e1b-4dee-a159-6842b93cd378" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1107.894953] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "port-17efb6ad-6e1b-4dee-a159-6842b93cd378" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1107.894953] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('17efb6ad-6e1b-4dee-a159-6842b93cd378',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1108.029116] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.029984] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.029984] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.029984] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.029984] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.030202] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.030319] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.030359] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.030538] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.030593] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.030702] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 is going to be updated. [ 1108.061277] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.061277] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.061277] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.061277] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.061277] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.072073] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 in Status: IN_PROGRESS for 2s [ 1108.397993] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.398282] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.398405] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.398684] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.398833] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.398983] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Segment Port 17efb6ad-6e1b-4dee-a159-6842b93cd378 not found, creating... [ 1108.399262] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.399417] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.399531] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.399740] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.399870] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.400160] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.400356] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.400477] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.400680] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.400833] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.400969] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Resource: SegmentPort with ID: 17efb6ad-6e1b-4dee-a159-6842b93cd378 is going to be created. [ 1108.420504] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.420698] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.420821] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.421096] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.421389] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.421611] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "port-17efb6ad-6e1b-4dee-a159-6842b93cd378" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.847191] env[67094]: INFO networking_nsxv3.common.synchronization [req-ce457360-66ab-4dc7-972a-67dfed7b9a91 req-6e1a5e36-df99-45c3-bb1e-c41280cdd9df tempest-ServersNegativeTestJSON-136657224 tempest-ServersNegativeTestJSON-136657224-project-member] Enqueued Resource ID: 280210af-8e3d-42c9-8854-42bd856b9dbe with Priority: HIGHEST for action security_group_members [ 1108.847795] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 280210af-8e3d-42c9-8854-42bd856b9dbe with Priority: HIGHEST for action security_group_members [ 1108.848139] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-280210af-8e3d-42c9-8854-42bd856b9dbe taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.848266] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.848266] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.848443] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.848571] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1108.848663] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1108.848718] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1108.848862] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1108.848944] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1108.849044] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('280210af-8e3d-42c9-8854-42bd856b9dbe',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.132171] env[67094]: INFO networking_nsxv3.common.synchronization [req-5868eb41-95e0-4f61-ad0c-df737bdf9c79 req-0a39cab5-6abb-4a44-9758-ba5fa7f954fe service nova] Enqueued Resource ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 with Priority: HIGHEST for action security_group_rules [ 1109.132440] env[67094]: INFO networking_nsxv3.common.synchronization [req-5868eb41-95e0-4f61-ad0c-df737bdf9c79 req-0a39cab5-6abb-4a44-9758-ba5fa7f954fe service nova] Enqueued Resource ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 with Priority: HIGHEST for action security_group_members [ 1109.132440] env[67094]: INFO networking_nsxv3.common.synchronization [req-5868eb41-95e0-4f61-ad0c-df737bdf9c79 req-0a39cab5-6abb-4a44-9758-ba5fa7f954fe service nova] Enqueued Resource ID: 17efb6ad-6e1b-4dee-a159-6842b93cd378 with Priority: HIGHEST for action port [ 1109.133075] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 with Priority: HIGHEST for action security_group_rules [ 1109.133176] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 with Priority: HIGHEST for action security_group_members [ 1109.133250] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17efb6ad-6e1b-4dee-a159-6842b93cd378 with Priority: HIGHEST for action port [ 1109.133512] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.133647] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.133686] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.133875] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.133954] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.134771] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.134996] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.135067] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-17efb6ad-6e1b-4dee-a159-6842b93cd378 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.135178] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-17efb6ad-6e1b-4dee-a159-6842b93cd378" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.135214] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-17efb6ad-6e1b-4dee-a159-6842b93cd378" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.135844] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-17efb6ad-6e1b-4dee-a159-6842b93cd378" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.135844] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('17efb6ad-6e1b-4dee-a159-6842b93cd378',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1109.350579] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.350738] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.350807] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.351041] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.351138] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.351363] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.351482] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.351546] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.351709] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.351785] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.351872] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 280210af-8e3d-42c9-8854-42bd856b9dbe is going to be updated. [ 1109.379290] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.379440] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.379508] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.379706] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.379847] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.389822] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 280210af-8e3d-42c9-8854-42bd856b9dbe in Status: IN_PROGRESS for 2s [ 1109.421046] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78a2df96-bab9-40fe-b845-1eec3b7d8df2 in Status: SUCCESS [ 1109.421394] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78a2df96-bab9-40fe-b845-1eec3b7d8df2 deletion is rescheduled due to dependency. [ 1109.421623] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78a2df96-bab9-40fe-b845-1eec3b7d8df2" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.638022] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.638022] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.638022] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 17efb6ad-6e1b-4dee-a159-6842b93cd378 with status ACTIVE [ 1109.638022] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.638022] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.638022] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.638411] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.638411] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.638561] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.638561] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.638646] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.638759] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.638834] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.639022] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.639116] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.639175] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.639312] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.639386] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.639473] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 17efb6ad-6e1b-4dee-a159-6842b93cd378 is going to be updated. [ 1109.662665] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.662829] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.662909] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.663129] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.663267] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.663435] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-17efb6ad-6e1b-4dee-a159-6842b93cd378" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.747043] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock network-766 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.747267] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "network-766" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.747391] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "network-766" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.747678] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "network-766" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.748070] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.748258] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.748382] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.748617] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.748770] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.748989] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1109.749123] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1109.749248] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1109.749383] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1109.749566] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1109.749747] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1109.749956] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1109.772122] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1109.772486] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1109.772714] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1109.773109] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "network-766" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1109.773529] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock port-6ab0549f-1e93-4566-9d65-b907d32e6914 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1109.773801] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "port-6ab0549f-1e93-4566-9d65-b907d32e6914" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1109.774020] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "port-6ab0549f-1e93-4566-9d65-b907d32e6914" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1109.774485] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "port-6ab0549f-1e93-4566-9d65-b907d32e6914" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1109.774712] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ab0549f-1e93-4566-9d65-b907d32e6914',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.083528] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 in Status: SUCCESS [ 1110.083707] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 deletion is rescheduled due to dependency. [ 1110.083828] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.084027] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.084284] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.084517] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.084660] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.084706] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.084888] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.085057] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.085172] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.277656] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.277961] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.277961] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.278422] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.278658] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.278867] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Segment Port 6ab0549f-1e93-4566-9d65-b907d32e6914 not found, creating... [ 1110.279188] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.279471] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.279636] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.279896] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.280082] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.280498] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.280749] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.280936] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.281209] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.281422] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.281645] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Resource: SegmentPort with ID: 6ab0549f-1e93-4566-9d65-b907d32e6914 is going to be created. [ 1110.319243] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.319602] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.319774] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.320082] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1110.320420] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.320661] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "port-6ab0549f-1e93-4566-9d65-b907d32e6914" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1110.589553] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1110.995677] env[67094]: INFO networking_nsxv3.common.synchronization [req-e450c18f-8de9-4ca2-a352-fbb2efd9a421 req-89b2a57e-1ed9-43e1-b746-4c117a008b18 service nova] Enqueued Resource ID: 882c69d3-9554-45c6-97a1-55fb0f065040 with Priority: HIGHEST for action security_group_rules [ 1110.995677] env[67094]: INFO networking_nsxv3.common.synchronization [req-e450c18f-8de9-4ca2-a352-fbb2efd9a421 req-89b2a57e-1ed9-43e1-b746-4c117a008b18 service nova] Enqueued Resource ID: 882c69d3-9554-45c6-97a1-55fb0f065040 with Priority: HIGHEST for action security_group_members [ 1110.995677] env[67094]: INFO networking_nsxv3.common.synchronization [req-e450c18f-8de9-4ca2-a352-fbb2efd9a421 req-89b2a57e-1ed9-43e1-b746-4c117a008b18 service nova] Enqueued Resource ID: 6ab0549f-1e93-4566-9d65-b907d32e6914 with Priority: HIGHEST for action port [ 1110.996085] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 882c69d3-9554-45c6-97a1-55fb0f065040 with Priority: HIGHEST for action security_group_rules [ 1110.996233] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 882c69d3-9554-45c6-97a1-55fb0f065040 with Priority: HIGHEST for action security_group_members [ 1110.996334] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab0549f-1e93-4566-9d65-b907d32e6914 with Priority: HIGHEST for action port [ 1110.996615] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-882c69d3-9554-45c6-97a1-55fb0f065040 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1110.996737] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1110.996804] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1110.997015] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.001270] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('882c69d3-9554-45c6-97a1-55fb0f065040',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.002425] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-882c69d3-9554-45c6-97a1-55fb0f065040 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.002567] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.002655] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.002867] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.003033] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.003136] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.003205] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.003374] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.003447] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.003541] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('882c69d3-9554-45c6-97a1-55fb0f065040',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.004406] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ab0549f-1e93-4566-9d65-b907d32e6914 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.004513] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ab0549f-1e93-4566-9d65-b907d32e6914" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.004579] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ab0549f-1e93-4566-9d65-b907d32e6914" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.004730] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ab0549f-1e93-4566-9d65-b907d32e6914" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.004805] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ab0549f-1e93-4566-9d65-b907d32e6914',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.093020] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.400704] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 280210af-8e3d-42c9-8854-42bd856b9dbe in Status: SUCCESS [ 1111.401091] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 280210af-8e3d-42c9-8854-42bd856b9dbe deletion is rescheduled due to dependency. [ 1111.401091] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.506755] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-882c69d3-9554-45c6-97a1-55fb0f065040 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.506927] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.507168] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('882c69d3-9554-45c6-97a1-55fb0f065040',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1111.508483] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6ab0549f-1e93-4566-9d65-b907d32e6914 with status ACTIVE [ 1111.508483] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.508693] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.508693] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.508818] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.508942] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.509180] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.509180] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.509350] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.509400] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.509444] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.510526] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.510526] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.510526] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.510526] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.510526] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.510526] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6ab0549f-1e93-4566-9d65-b907d32e6914 is going to be updated. [ 1111.536476] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.536476] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.536476] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.536476] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.536476] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.536476] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ab0549f-1e93-4566-9d65-b907d32e6914" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.595939] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.596123] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.596198] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.596424] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.596514] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.596615] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 is going to be updated. [ 1111.650532] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1111.650717] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1111.652217] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1111.652217] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1111.652217] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1111.676020] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 in Status: IN_PROGRESS for 2s [ 1112.012269] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('882c69d3-9554-45c6-97a1-55fb0f065040',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.223653] env[67094]: INFO networking_nsxv3.common.synchronization [req-9b112364-9312-4f87-9bbd-1bb90773f17c req-a4704d21-61b3-4162-8b93-2a423dff8232 tempest-ServerRescueNegativeTestJSON-389115858 tempest-ServerRescueNegativeTestJSON-389115858-project-member] Enqueued Resource ID: 34b6178d-c850-4655-81a1-f452d6a6f576 with Priority: HIGHEST for action security_group_members [ 1112.224024] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34b6178d-c850-4655-81a1-f452d6a6f576 with Priority: HIGHEST for action security_group_members [ 1112.224408] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-34b6178d-c850-4655-81a1-f452d6a6f576 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.224475] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-34b6178d-c850-4655-81a1-f452d6a6f576" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.224578] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-34b6178d-c850-4655-81a1-f452d6a6f576" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.224774] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-34b6178d-c850-4655-81a1-f452d6a6f576" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.224945] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.225017] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.225380] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.225444] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.225576] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.225715] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('34b6178d-c850-4655-81a1-f452d6a6f576',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1112.515508] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.515902] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.515902] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.516189] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.516415] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.516648] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 882c69d3-9554-45c6-97a1-55fb0f065040 is going to be updated. [ 1112.552847] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.552847] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.552847] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.552847] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.552847] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.561471] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882c69d3-9554-45c6-97a1-55fb0f065040 in Status: IN_PROGRESS for 2s [ 1112.728237] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.728463] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.728557] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.728793] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.753949] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.754342] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.754504] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.754596] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.755023] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.755103] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.755247] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34b6178d-c850-4655-81a1-f452d6a6f576 is going to be updated. [ 1112.786230] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1112.786385] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1112.786476] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1112.786811] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1112.787066] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1112.796173] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34b6178d-c850-4655-81a1-f452d6a6f576 in Status: IN_PROGRESS for 2s [ 1113.688556] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 in Status: SUCCESS [ 1113.688556] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.688848] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.688848] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.689068] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1113.689153] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1113.689223] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1113.689380] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1113.689463] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.689550] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1113.689637] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.191988] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.192176] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.192241] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.192483] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.192657] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.192757] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.192839] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.192990] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.193095] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.193184] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.193334] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.193447] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.193486] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.193643] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.193779] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.194130] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.194130] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.194130] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.194130] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.194378] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.194378] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.573695] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882c69d3-9554-45c6-97a1-55fb0f065040 in Status: SUCCESS [ 1114.574942] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.574942] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.574942] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.574942] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.574942] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.574942] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.575252] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.575252] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.575313] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.575405] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('882c69d3-9554-45c6-97a1-55fb0f065040',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1114.697209] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6: rpc.has_security_group_logging(os_id): False [ 1114.728741] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.728895] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.728992] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.729226] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.729294] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.729476] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.729577] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.729642] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.729800] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.729915] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.730164] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.730251] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.730352] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.730486] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.730562] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.730743] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.730836] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.730889] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.731039] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.731113] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.731196] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 is going to be updated. [ 1114.807534] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 34b6178d-c850-4655-81a1-f452d6a6f576 in Status: SUCCESS [ 1114.807742] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 34b6178d-c850-4655-81a1-f452d6a6f576 deletion is rescheduled due to dependency. [ 1114.807823] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-34b6178d-c850-4655-81a1-f452d6a6f576" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.809461] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1114.809606] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1114.809656] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1114.809853] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1114.809994] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1114.821970] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 in Status: IN_PROGRESS for 2s [ 1115.079633] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-882c69d3-9554-45c6-97a1-55fb0f065040 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.079633] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.079633] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.079633] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.079633] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.079633] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.080066] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.080066] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.080066] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.080167] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.080497] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-882c69d3-9554-45c6-97a1-55fb0f065040 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.080497] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.080641] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.082820] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.082820] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.082820] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.082820] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.082820] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.082820] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.082820] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.082820] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('882c69d3-9554-45c6-97a1-55fb0f065040',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.586639] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 882c69d3-9554-45c6-97a1-55fb0f065040: rpc.has_security_group_logging(os_id): False [ 1115.606678] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.607042] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.607042] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.607166] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.607201] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.607405] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.607514] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.607580] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.607712] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.607782] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.607957] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.608055] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.608186] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.608302] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.608384] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.608548] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.608675] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.608675] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.608814] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.608883] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.608953] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 882c69d3-9554-45c6-97a1-55fb0f065040 is going to be updated. [ 1115.636235] env[67094]: INFO networking_nsxv3.common.synchronization [req-ccf97408-6a8a-481c-b2b3-9863e3d97923 req-bbb45dc9-9df0-4ee2-9329-d44d3fdf5d2a tempest-DeleteServersTestJSON-1237946437 tempest-DeleteServersTestJSON-1237946437-project-member] Enqueued Resource ID: 276c2084-ac8d-475a-af24-a062dc3e17aa with Priority: HIGHEST for action security_group_members [ 1115.636832] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 276c2084-ac8d-475a-af24-a062dc3e17aa with Priority: HIGHEST for action security_group_members [ 1115.637184] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-276c2084-ac8d-475a-af24-a062dc3e17aa taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.637304] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.637469] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.637568] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.637722] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.637820] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.637877] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.638037] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.638125] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.638210] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('276c2084-ac8d-475a-af24-a062dc3e17aa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1115.674198] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.674382] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.674441] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.674616] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.674760] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.694464] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 882c69d3-9554-45c6-97a1-55fb0f065040 in Status: IN_PROGRESS for 2s [ 1115.939732] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock network-318 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.940162] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "network-318" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.940247] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "network-318" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.940583] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "network-318" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.940908] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.941142] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.941321] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.941595] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.941795] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.942065] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1115.942239] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1115.942404] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1115.942566] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1115.942734] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1115.942895] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1115.943103] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1115.962196] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1115.962454] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1115.962583] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1115.962793] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "network-318" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1115.963175] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock port-d0796aab-be8d-4fb9-a8a9-90e63dd77fd8 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1115.963386] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "port-d0796aab-be8d-4fb9-a8a9-90e63dd77fd8" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1115.963547] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "port-d0796aab-be8d-4fb9-a8a9-90e63dd77fd8" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1115.963908] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "port-d0796aab-be8d-4fb9-a8a9-90e63dd77fd8" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1115.964092] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0796aab-be8d-4fb9-a8a9-90e63dd77fd8',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1116.141112] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.141326] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.141374] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.141575] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.141663] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.141894] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.141996] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.142070] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.142228] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.142304] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.142392] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 276c2084-ac8d-475a-af24-a062dc3e17aa is going to be updated. [ 1116.170430] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.170649] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.170697] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.170966] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.171130] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.189126] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 276c2084-ac8d-475a-af24-a062dc3e17aa in Status: IN_PROGRESS for 2s [ 1116.468659] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.469052] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.469221] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.469534] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.469725] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.469888] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Segment Port d0796aab-be8d-4fb9-a8a9-90e63dd77fd8 not found, creating... [ 1116.470286] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.470606] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.471500] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.471500] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.471500] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.471800] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.472017] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.472152] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.472431] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.472700] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.472977] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Resource: SegmentPort with ID: d0796aab-be8d-4fb9-a8a9-90e63dd77fd8 is going to be created. [ 1116.495841] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1116.496040] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1116.496128] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1116.496439] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1116.497922] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.497922] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "port-d0796aab-be8d-4fb9-a8a9-90e63dd77fd8" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1116.839699] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 in Status: SUCCESS [ 1116.839966] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.217669] env[67094]: INFO networking_nsxv3.common.synchronization [req-ccf97408-6a8a-481c-b2b3-9863e3d97923 req-20a2dfda-b4e8-4fcf-8f66-d63a053c3097 service nova] Enqueued Resource ID: 276c2084-ac8d-475a-af24-a062dc3e17aa with Priority: HIGHEST for action security_group_rules [ 1117.217928] env[67094]: INFO networking_nsxv3.common.synchronization [req-ccf97408-6a8a-481c-b2b3-9863e3d97923 req-20a2dfda-b4e8-4fcf-8f66-d63a053c3097 service nova] Enqueued Resource ID: 276c2084-ac8d-475a-af24-a062dc3e17aa with Priority: HIGHEST for action security_group_members [ 1117.218212] env[67094]: INFO networking_nsxv3.common.synchronization [req-ccf97408-6a8a-481c-b2b3-9863e3d97923 req-20a2dfda-b4e8-4fcf-8f66-d63a053c3097 service nova] Enqueued Resource ID: d0796aab-be8d-4fb9-a8a9-90e63dd77fd8 with Priority: HIGHEST for action port [ 1117.218565] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 276c2084-ac8d-475a-af24-a062dc3e17aa with Priority: HIGHEST for action security_group_rules [ 1117.218706] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 276c2084-ac8d-475a-af24-a062dc3e17aa with Priority: HIGHEST for action security_group_members [ 1117.218803] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d0796aab-be8d-4fb9-a8a9-90e63dd77fd8 with Priority: HIGHEST for action port [ 1117.219635] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-276c2084-ac8d-475a-af24-a062dc3e17aa taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.219773] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.219864] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.220050] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.220136] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('276c2084-ac8d-475a-af24-a062dc3e17aa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.221048] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-276c2084-ac8d-475a-af24-a062dc3e17aa taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.221147] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.222082] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-d0796aab-be8d-4fb9-a8a9-90e63dd77fd8 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.222082] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d0796aab-be8d-4fb9-a8a9-90e63dd77fd8" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.222082] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d0796aab-be8d-4fb9-a8a9-90e63dd77fd8" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.222082] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d0796aab-be8d-4fb9-a8a9-90e63dd77fd8" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.222082] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d0796aab-be8d-4fb9-a8a9-90e63dd77fd8',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1117.709209] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 882c69d3-9554-45c6-97a1-55fb0f065040 in Status: SUCCESS [ 1117.709506] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.724113] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-276c2084-ac8d-475a-af24-a062dc3e17aa taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.724240] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.724429] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d0796aab-be8d-4fb9-a8a9-90e63dd77fd8 with status ACTIVE [ 1117.724595] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.724704] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.724770] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.724987] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.725091] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.725267] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.725365] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.725427] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.725580] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.725655] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.725831] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.725926] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.725985] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.726135] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.726207] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.726290] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d0796aab-be8d-4fb9-a8a9-90e63dd77fd8 is going to be updated. [ 1117.747946] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1117.748159] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1117.748209] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1117.748414] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1117.748553] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1117.748718] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d0796aab-be8d-4fb9-a8a9-90e63dd77fd8" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.202936] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 276c2084-ac8d-475a-af24-a062dc3e17aa in Status: SUCCESS [ 1118.203189] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 276c2084-ac8d-475a-af24-a062dc3e17aa deletion is rescheduled due to dependency. [ 1118.203350] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.203530] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.203792] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.204018] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1118.204162] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1118.204258] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1118.204433] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1118.204524] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1118.204636] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('276c2084-ac8d-475a-af24-a062dc3e17aa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1118.706682] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('276c2084-ac8d-475a-af24-a062dc3e17aa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.210136] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('276c2084-ac8d-475a-af24-a062dc3e17aa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.713048] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.716029] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.716029] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.716029] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.716029] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.716029] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 276c2084-ac8d-475a-af24-a062dc3e17aa is going to be updated. [ 1119.717933] env[67094]: INFO networking_nsxv3.common.synchronization [req-580088e6-cc7b-4843-8833-009b1ec4b552 req-1543f2b0-32be-48d7-92e3-4a16f6084ec1 tempest-ServerDiskConfigTestJSON-51233165 tempest-ServerDiskConfigTestJSON-51233165-project-member] Enqueued Resource ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 with Priority: HIGHEST for action security_group_members [ 1119.719916] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 with Priority: HIGHEST for action security_group_members [ 1119.720242] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.720415] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.720484] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.720675] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.720831] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.720927] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.720988] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.724922] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.724922] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.724922] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1119.749770] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.749977] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.749977] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.750204] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.750428] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1119.760233] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 276c2084-ac8d-475a-af24-a062dc3e17aa in Status: IN_PROGRESS for 2s [ 1119.951447] env[67094]: INFO networking_nsxv3.common.synchronization [None req-f80e9595-3f2a-4f2a-ad75-0c7638c8d69b None None] Enqueued Resource ID: b94354db-dd8f-4a58-b145-754da7d2196d with Priority: HIGHEST for action port [ 1119.952038] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b94354db-dd8f-4a58-b145-754da7d2196d with Priority: HIGHEST for action port [ 1119.952354] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-b94354db-dd8f-4a58-b145-754da7d2196d taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1119.952478] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b94354db-dd8f-4a58-b145-754da7d2196d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1119.952574] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b94354db-dd8f-4a58-b145-754da7d2196d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1119.952793] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b94354db-dd8f-4a58-b145-754da7d2196d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1119.952876] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b94354db-dd8f-4a58-b145-754da7d2196d',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1120.225923] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.226115] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.226186] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.226402] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.226518] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.226698] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.228074] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.228954] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.228954] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.228954] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.228954] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 is going to be updated. [ 1120.261026] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.261026] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.261026] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.261026] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.261026] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.269264] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 in Status: IN_PROGRESS for 2s [ 1120.460500] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port b94354db-dd8f-4a58-b145-754da7d2196d [ 1120.461320] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1120.461320] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1120.461320] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1120.461320] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1120.461593] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1120.461593] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:b94354db-dd8f-4a58-b145-754da7d2196d already deleted. [ 1120.461593] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b94354db-dd8f-4a58-b145-754da7d2196d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.783627] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 276c2084-ac8d-475a-af24-a062dc3e17aa in Status: SUCCESS [ 1121.784111] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.784179] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.784431] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.784634] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1121.784758] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1121.784870] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1121.785056] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1121.785154] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.785311] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1121.785461] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('276c2084-ac8d-475a-af24-a062dc3e17aa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.023405] env[67094]: INFO networking_nsxv3.common.synchronization [None req-5af2214a-902a-4c87-9d7b-a4bf650a02d1 None None] Enqueued Resource ID: ce9b90bc-dcc6-433d-8183-6446c2fb0232 with Priority: HIGHEST for action port [ 1122.023405] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce9b90bc-dcc6-433d-8183-6446c2fb0232 with Priority: HIGHEST for action port [ 1122.023405] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-ce9b90bc-dcc6-433d-8183-6446c2fb0232 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.023405] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ce9b90bc-dcc6-433d-8183-6446c2fb0232" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.023405] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ce9b90bc-dcc6-433d-8183-6446c2fb0232" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.023405] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ce9b90bc-dcc6-433d-8183-6446c2fb0232" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.023405] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce9b90bc-dcc6-433d-8183-6446c2fb0232',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.281176] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 in Status: SUCCESS [ 1122.281418] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6 deletion is rescheduled due to dependency. [ 1122.281569] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.287549] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-276c2084-ac8d-475a-af24-a062dc3e17aa taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.287723] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.287774] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.287966] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.288181] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.288287] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.288349] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.288508] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.288590] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.288678] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.288816] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-276c2084-ac8d-475a-af24-a062dc3e17aa taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.288958] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.288958] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.289103] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.289234] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.289326] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.289401] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.289520] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.289590] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.289671] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.289769] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('276c2084-ac8d-475a-af24-a062dc3e17aa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1122.525707] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] deletion realization of port ce9b90bc-dcc6-433d-8183-6446c2fb0232 [ 1122.525707] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.525992] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.526140] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.526485] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.526621] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.527143] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Segment Port:ce9b90bc-dcc6-433d-8183-6446c2fb0232 already deleted. [ 1122.527143] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ce9b90bc-dcc6-433d-8183-6446c2fb0232" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.792257] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 276c2084-ac8d-475a-af24-a062dc3e17aa: rpc.has_security_group_logging(os_id): False [ 1122.811115] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.811261] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.811336] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.811539] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.811627] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.811845] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.811946] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.812024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.812311] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.812382] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.812560] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.812667] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.812719] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.812839] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.812911] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.813244] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.813244] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.813244] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.813426] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.813426] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.813503] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 276c2084-ac8d-475a-af24-a062dc3e17aa is going to be updated. [ 1122.877256] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1122.877431] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1122.877501] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1122.877698] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1122.877843] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1122.892603] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 276c2084-ac8d-475a-af24-a062dc3e17aa in Status: IN_PROGRESS for 2s [ 1124.908785] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 276c2084-ac8d-475a-af24-a062dc3e17aa in Status: SUCCESS [ 1124.909105] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.734060] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock network-766 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.734328] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "network-766" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.734395] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "network-766" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.734663] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "network-766" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.734931] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.735106] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.735224] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.735440] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.735588] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.735928] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1126.736071] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1126.736185] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1126.736291] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1126.736401] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1126.736506] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1126.736635] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1126.774922] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1126.774922] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Cache value generated in 0.038 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1126.775142] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1126.775324] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "network-766" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1126.775644] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock port-6ab0549f-1e93-4566-9d65-b907d32e6914 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1126.775821] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "port-6ab0549f-1e93-4566-9d65-b907d32e6914" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1126.775957] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "port-6ab0549f-1e93-4566-9d65-b907d32e6914" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1126.776294] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "port-6ab0549f-1e93-4566-9d65-b907d32e6914" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1126.776441] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ab0549f-1e93-4566-9d65-b907d32e6914',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1127.022793] env[67094]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1127.022971] env[67094]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1127.279135] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.279452] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.279512] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.279768] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.279920] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.280244] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.280452] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.280581] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.280791] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.280928] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.281222] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.281399] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.281507] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.281714] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.281850] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.281988] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Resource: SegmentPort with ID: 6ab0549f-1e93-4566-9d65-b907d32e6914 is going to be updated. [ 1127.305273] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1127.305530] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1127.305669] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1127.305980] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1127.306204] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1127.306428] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "port-6ab0549f-1e93-4566-9d65-b907d32e6914" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.009714] env[67094]: INFO networking_nsxv3.common.synchronization [req-56858aaf-1614-4dd6-b566-5f1425b5934f req-cbdf44ce-1467-4883-bb31-947f07c1f558 service nova] Enqueued Resource ID: 882c69d3-9554-45c6-97a1-55fb0f065040 with Priority: HIGHEST for action security_group_rules [ 1128.009714] env[67094]: INFO networking_nsxv3.common.synchronization [req-56858aaf-1614-4dd6-b566-5f1425b5934f req-cbdf44ce-1467-4883-bb31-947f07c1f558 service nova] Enqueued Resource ID: 882c69d3-9554-45c6-97a1-55fb0f065040 with Priority: HIGHEST for action security_group_members [ 1128.009979] env[67094]: INFO networking_nsxv3.common.synchronization [req-56858aaf-1614-4dd6-b566-5f1425b5934f req-cbdf44ce-1467-4883-bb31-947f07c1f558 service nova] Enqueued Resource ID: 6ab0549f-1e93-4566-9d65-b907d32e6914 with Priority: HIGHEST for action port [ 1128.010596] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 882c69d3-9554-45c6-97a1-55fb0f065040 with Priority: HIGHEST for action security_group_rules [ 1128.010596] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 882c69d3-9554-45c6-97a1-55fb0f065040 with Priority: HIGHEST for action security_group_members [ 1128.010717] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6ab0549f-1e93-4566-9d65-b907d32e6914 with Priority: HIGHEST for action port [ 1128.010944] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-882c69d3-9554-45c6-97a1-55fb0f065040 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.011081] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.011148] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.011364] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.011476] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('882c69d3-9554-45c6-97a1-55fb0f065040',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.012302] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-882c69d3-9554-45c6-97a1-55fb0f065040 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.012412] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.012480] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.013106] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.013106] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.013106] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.013106] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.013106] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.013498] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.013498] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('882c69d3-9554-45c6-97a1-55fb0f065040',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.014290] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-6ab0549f-1e93-4566-9d65-b907d32e6914 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.014407] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-6ab0549f-1e93-4566-9d65-b907d32e6914" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.014483] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-6ab0549f-1e93-4566-9d65-b907d32e6914" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.014653] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-6ab0549f-1e93-4566-9d65-b907d32e6914" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.014745] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('6ab0549f-1e93-4566-9d65-b907d32e6914',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.518657] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('882c69d3-9554-45c6-97a1-55fb0f065040',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1128.518657] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-882c69d3-9554-45c6-97a1-55fb0f065040 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.518657] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.518657] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 6ab0549f-1e93-4566-9d65-b907d32e6914 with status ACTIVE [ 1128.518657] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.518657] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.518657] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.518657] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.518657] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.518657] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.518657] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.518657] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.519664] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.519974] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.520441] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.520734] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.520909] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.521156] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.521320] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.521538] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 6ab0549f-1e93-4566-9d65-b907d32e6914 is going to be updated. [ 1128.543887] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.543887] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.543887] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.544281] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.544281] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.544348] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-6ab0549f-1e93-4566-9d65-b907d32e6914" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.760224] env[67094]: INFO networking_nsxv3.common.synchronization [req-8230424d-163f-4a9c-956d-e52a1546b3ea req-e19e420f-a7ed-42eb-8e94-643493caea8d tempest-MultipleCreateTestJSON-360930871 tempest-MultipleCreateTestJSON-360930871-project-member] Enqueued Resource ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 with Priority: HIGHEST for action security_group_members [ 1128.760863] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 with Priority: HIGHEST for action security_group_members [ 1128.761189] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.761314] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.761417] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.761639] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.761800] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1128.761900] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1128.761962] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1128.762285] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1128.762378] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1128.762474] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.018765] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('882c69d3-9554-45c6-97a1-55fb0f065040',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.171425] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock network-785 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.171425] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "network-785" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.171425] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "network-785" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.171425] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "network-785" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.172642] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.172642] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.172642] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.172642] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.172642] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.172934] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1129.173011] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1129.173076] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1129.174571] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1129.174571] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1129.174571] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1129.174733] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1129.206038] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1129.206038] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Cache value generated in 0.031 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1129.206038] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1129.206291] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "network-785" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.206603] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock port-41f295bd-fc91-4938-b321-9d62162a5a2e taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.206871] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "port-41f295bd-fc91-4938-b321-9d62162a5a2e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.207188] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "port-41f295bd-fc91-4938-b321-9d62162a5a2e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.207673] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "port-41f295bd-fc91-4938-b321-9d62162a5a2e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.207943] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41f295bd-fc91-4938-b321-9d62162a5a2e',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1129.264372] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.264555] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.264625] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.264843] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.264929] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.265142] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.265238] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.265298] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.265450] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.265526] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.265606] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 already deleted. [ 1129.265685] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.524029] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.524029] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.524029] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.524029] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.524029] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.524029] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 882c69d3-9554-45c6-97a1-55fb0f065040 is going to be updated. [ 1129.553209] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.553359] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.553418] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.553624] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.553772] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.563234] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882c69d3-9554-45c6-97a1-55fb0f065040 in Status: IN_PROGRESS for 2s [ 1129.711301] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.711617] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.711777] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.712101] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.712276] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.712438] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Segment Port 41f295bd-fc91-4938-b321-9d62162a5a2e not found, creating... [ 1129.712765] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.712968] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.713110] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.713357] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.713508] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.713801] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.713983] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.714121] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.714392] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.714706] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.714891] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Resource: SegmentPort with ID: 41f295bd-fc91-4938-b321-9d62162a5a2e is going to be created. [ 1129.739465] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1129.739669] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1129.739842] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1129.740171] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1129.740471] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1129.740745] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "port-41f295bd-fc91-4938-b321-9d62162a5a2e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.480888] env[67094]: INFO networking_nsxv3.common.synchronization [req-8230424d-163f-4a9c-956d-e52a1546b3ea req-ba5be43a-b6b3-4fb8-ac33-b25b1270ca24 service nova] Enqueued Resource ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 with Priority: HIGHEST for action security_group_rules [ 1130.480888] env[67094]: INFO networking_nsxv3.common.synchronization [req-8230424d-163f-4a9c-956d-e52a1546b3ea req-ba5be43a-b6b3-4fb8-ac33-b25b1270ca24 service nova] Enqueued Resource ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 with Priority: HIGHEST for action security_group_members [ 1130.480888] env[67094]: INFO networking_nsxv3.common.synchronization [req-8230424d-163f-4a9c-956d-e52a1546b3ea req-ba5be43a-b6b3-4fb8-ac33-b25b1270ca24 service nova] Enqueued Resource ID: 41f295bd-fc91-4938-b321-9d62162a5a2e with Priority: HIGHEST for action port [ 1130.481465] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 with Priority: HIGHEST for action security_group_rules [ 1130.481465] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 with Priority: HIGHEST for action security_group_members [ 1130.481465] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 41f295bd-fc91-4938-b321-9d62162a5a2e with Priority: HIGHEST for action port [ 1130.481585] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.481701] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.481790] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.482177] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.482267] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.483129] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.483243] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.483309] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.483475] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.483616] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.483777] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.483777] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.483897] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.484037] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.484095] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.485501] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-41f295bd-fc91-4938-b321-9d62162a5a2e taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.487171] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-41f295bd-fc91-4938-b321-9d62162a5a2e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.487238] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-41f295bd-fc91-4938-b321-9d62162a5a2e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.487413] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-41f295bd-fc91-4938-b321-9d62162a5a2e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.487528] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('41f295bd-fc91-4938-b321-9d62162a5a2e',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.584488] env[67094]: INFO networking_nsxv3.common.synchronization [req-8230424d-163f-4a9c-956d-e52a1546b3ea req-5b962397-30c8-464b-a26d-7ca8ecdffbf3 tempest-MultipleCreateTestJSON-360930871 tempest-MultipleCreateTestJSON-360930871-project-member] Enqueued Resource ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 with Priority: HIGHEST for action security_group_members [ 1130.585063] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 with Priority: HIGHEST for action security_group_members [ 1130.585385] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.586052] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.896471] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock network-785 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.896670] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "network-785" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.896790] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "network-785" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.897109] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "network-785" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.897366] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.897519] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.897618] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.897829] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.898083] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.898186] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1130.898296] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1130.898400] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1130.898505] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1130.898609] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1130.898711] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1130.898836] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1130.929052] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1130.929052] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Cache value generated in 0.030 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1130.929052] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1130.929304] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "network-785" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.929451] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock port-d8790884-0707-421b-952e-481a657f0303 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.929628] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "port-d8790884-0707-421b-952e-481a657f0303" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.929745] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "port-d8790884-0707-421b-952e-481a657f0303" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.930079] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "port-d8790884-0707-421b-952e-481a657f0303" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.930220] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8790884-0707-421b-952e-481a657f0303',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.988828] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1130.989883] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.990027] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.990356] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 41f295bd-fc91-4938-b321-9d62162a5a2e with status ACTIVE [ 1130.990680] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.990806] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.990876] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.991099] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.991189] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.991395] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.991620] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.991700] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.991885] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.991971] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.992192] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1130.992292] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1130.992354] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1130.992533] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1130.992615] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1130.992704] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 41f295bd-fc91-4938-b321-9d62162a5a2e is going to be updated. [ 1131.015554] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.015775] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.015775] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.015936] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.016082] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.016245] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-41f295bd-fc91-4938-b321-9d62162a5a2e" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.433854] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.433854] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.433854] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.434092] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.434245] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.434447] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Segment Port d8790884-0707-421b-952e-481a657f0303 not found, creating... [ 1131.434786] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.435082] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.435270] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.435545] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.438071] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.438071] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.438071] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.438071] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.438071] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.438071] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.438071] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Resource: SegmentPort with ID: d8790884-0707-421b-952e-481a657f0303 is going to be created. [ 1131.457697] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.457999] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.458196] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.458504] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.458746] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.459032] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "port-d8790884-0707-421b-952e-481a657f0303" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.491097] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.574272] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882c69d3-9554-45c6-97a1-55fb0f065040 in Status: SUCCESS [ 1131.574495] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.574662] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.574877] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.575085] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.575795] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.575795] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.575795] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.575795] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.575795] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.575795] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('882c69d3-9554-45c6-97a1-55fb0f065040',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1131.994916] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1131.996197] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1131.996197] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1131.996197] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1131.996197] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1131.996197] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 is going to be created. [ 1132.029238] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.029473] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.030022] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.030022] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.030685] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.048410] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 in Status: UNINITIALIZED for 2s [ 1132.078778] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-882c69d3-9554-45c6-97a1-55fb0f065040 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.080029] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.080134] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.080341] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.080588] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.080701] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.080789] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.080942] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.081026] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.081133] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.081280] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-882c69d3-9554-45c6-97a1-55fb0f065040 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.081385] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.082038] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.082038] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.082038] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.082038] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.082038] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.082267] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.082267] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.082328] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.082413] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('882c69d3-9554-45c6-97a1-55fb0f065040',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.361237] env[67094]: INFO networking_nsxv3.common.synchronization [req-8230424d-163f-4a9c-956d-e52a1546b3ea req-573617ad-38b2-4b19-ad88-eb99057255c9 service nova] Enqueued Resource ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 with Priority: HIGHEST for action security_group_rules [ 1132.361237] env[67094]: INFO networking_nsxv3.common.synchronization [req-8230424d-163f-4a9c-956d-e52a1546b3ea req-573617ad-38b2-4b19-ad88-eb99057255c9 service nova] Enqueued Resource ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 with Priority: HIGHEST for action security_group_members [ 1132.361237] env[67094]: INFO networking_nsxv3.common.synchronization [req-8230424d-163f-4a9c-956d-e52a1546b3ea req-573617ad-38b2-4b19-ad88-eb99057255c9 service nova] Enqueued Resource ID: d8790884-0707-421b-952e-481a657f0303 with Priority: HIGHEST for action port [ 1132.364352] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 with Priority: HIGHEST for action security_group_rules [ 1132.364352] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 with Priority: HIGHEST for action security_group_members [ 1132.364352] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: d8790884-0707-421b-952e-481a657f0303 with Priority: HIGHEST for action port [ 1132.364352] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.364352] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.364352] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.364352] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.364782] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-d8790884-0707-421b-952e-481a657f0303 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.364782] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-d8790884-0707-421b-952e-481a657f0303" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.364896] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-d8790884-0707-421b-952e-481a657f0303" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.367548] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-d8790884-0707-421b-952e-481a657f0303" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.367548] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('d8790884-0707-421b-952e-481a657f0303',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1132.586229] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 882c69d3-9554-45c6-97a1-55fb0f065040: rpc.has_security_group_logging(os_id): False [ 1132.607523] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.607678] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.607788] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.608127] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.608257] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.608537] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.608668] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.609064] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.609064] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.610601] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.610601] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.610601] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.610601] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.612428] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.612428] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.612634] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.612750] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.612865] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.613169] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.613169] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.613272] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 882c69d3-9554-45c6-97a1-55fb0f065040 is going to be updated. [ 1132.708349] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.708349] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.708349] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.708349] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.708349] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.729670] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 882c69d3-9554-45c6-97a1-55fb0f065040 in Status: IN_PROGRESS for 2s [ 1132.868953] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port d8790884-0707-421b-952e-481a657f0303 with status ACTIVE [ 1132.869173] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.869368] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.869422] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.869669] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.869760] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.869954] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.870078] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.870169] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.870294] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.870397] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.870750] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.870894] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.871009] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.871276] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.871445] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.871545] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: d8790884-0707-421b-952e-481a657f0303 is going to be updated. [ 1132.901301] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1132.901437] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1132.901498] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1132.901695] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1132.901836] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1132.902021] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-d8790884-0707-421b-952e-481a657f0303" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.059196] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 in Status: SUCCESS [ 1134.059674] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.059674] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.059824] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.060037] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.060173] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.060256] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.060441] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.060511] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.060599] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.564048] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.709060] env[67094]: INFO networking_nsxv3.common.synchronization [req-a105616f-159d-46d7-8e4a-48e575e82a03 req-85da5100-754f-4a17-b9d8-05b883bab6dc tempest-ServerActionsTestOtherA-276518123 tempest-ServerActionsTestOtherA-276518123-project-member] Enqueued Resource ID: 4ec74abc-987a-4435-8c42-e7e606ef3293 with Priority: HIGHEST for action security_group_members [ 1134.714402] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ec74abc-987a-4435-8c42-e7e606ef3293 with Priority: HIGHEST for action security_group_members [ 1134.715397] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-4ec74abc-987a-4435-8c42-e7e606ef3293 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.715608] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-4ec74abc-987a-4435-8c42-e7e606ef3293" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.715735] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-4ec74abc-987a-4435-8c42-e7e606ef3293" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.715994] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-4ec74abc-987a-4435-8c42-e7e606ef3293" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.716205] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1134.716313] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1134.716381] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1134.716591] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1134.716690] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1134.716811] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('4ec74abc-987a-4435-8c42-e7e606ef3293',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1134.784665] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 882c69d3-9554-45c6-97a1-55fb0f065040 in Status: SUCCESS [ 1134.785189] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.067089] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1135.220841] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.221025] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.221102] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.221331] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.243872] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.244197] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.244363] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.244448] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.244734] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.244830] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.244929] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ec74abc-987a-4435-8c42-e7e606ef3293 is going to be updated. [ 1135.275062] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.275224] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.275295] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.275517] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.275710] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.286422] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ec74abc-987a-4435-8c42-e7e606ef3293 in Status: IN_PROGRESS for 2s [ 1135.570568] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.570757] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.570839] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.571076] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.571168] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.571272] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 is going to be updated. [ 1135.610216] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1135.610949] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1135.610949] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1135.610949] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1135.610949] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1135.622662] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 in Status: IN_PROGRESS for 2s [ 1137.301973] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 4ec74abc-987a-4435-8c42-e7e606ef3293 in Status: SUCCESS [ 1137.302436] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 4ec74abc-987a-4435-8c42-e7e606ef3293 deletion is rescheduled due to dependency. [ 1137.302436] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-4ec74abc-987a-4435-8c42-e7e606ef3293" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.635283] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 in Status: SUCCESS [ 1137.635556] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.635691] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.635919] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.636676] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.636676] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.636676] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.636849] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.636849] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.636966] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.637050] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1137.638583] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.638903] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.639079] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1137.639241] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1137.639278] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1137.639401] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1137.639481] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1137.639575] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.139635] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.139864] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.141369] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.400252] env[67094]: INFO networking_nsxv3.common.synchronization [req-0cf36585-271b-44a2-90fd-dbf0c7505c2f req-bdb09d34-92a7-4dc0-b7ad-d8719862870c tempest-ServersTestBootFromVolume-467953286 tempest-ServersTestBootFromVolume-467953286-project-member] Enqueued Resource ID: 7d339cc8-3c0d-42f5-b975-687230de264b with Priority: HIGHEST for action security_group_members [ 1138.401041] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7d339cc8-3c0d-42f5-b975-687230de264b with Priority: HIGHEST for action security_group_members [ 1138.406150] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-7d339cc8-3c0d-42f5-b975-687230de264b taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.406150] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7d339cc8-3c0d-42f5-b975-687230de264b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.406150] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7d339cc8-3c0d-42f5-b975-687230de264b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.406150] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7d339cc8-3c0d-42f5-b975-687230de264b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.406150] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.406150] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.406150] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.406436] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.406436] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.406602] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7d339cc8-3c0d-42f5-b975-687230de264b',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.643328] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1138.909242] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.909539] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.909539] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.909810] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.909965] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.910249] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.910379] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.910522] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.910775] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.910907] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.911020] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d339cc8-3c0d-42f5-b975-687230de264b is going to be updated. [ 1138.943174] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1138.943396] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1138.943512] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1138.943675] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1138.943923] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1138.955012] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d339cc8-3c0d-42f5-b975-687230de264b in Status: IN_PROGRESS for 2s [ 1139.146032] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.146170] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.146286] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.146553] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.146702] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.146839] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 is going to be updated. [ 1139.182677] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1139.182859] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1139.182910] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1139.183150] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1139.183337] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1139.195185] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 in Status: IN_PROGRESS for 2s [ 1140.967987] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7d339cc8-3c0d-42f5-b975-687230de264b in Status: SUCCESS [ 1140.967987] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7d339cc8-3c0d-42f5-b975-687230de264b deletion is rescheduled due to dependency. [ 1140.967987] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7d339cc8-3c0d-42f5-b975-687230de264b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.208654] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 in Status: SUCCESS [ 1141.208654] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.209395] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.209395] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.209395] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.209721] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.209721] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.209721] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.209862] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.209862] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.210797] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.210797] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.210797] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.210797] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.210797] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.211059] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.211059] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.211239] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.211239] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.211409] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.211591] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1141.713589] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6: rpc.has_security_group_logging(os_id): False [ 1141.736694] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.736849] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.736944] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.737183] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.737330] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.737498] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.737633] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.737692] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.737850] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.737925] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.738139] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.738238] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.738310] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.738437] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.738511] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.738706] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.738796] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.738855] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.739019] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.739099] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.739189] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 is going to be created. [ 1141.828254] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1141.828540] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1141.828654] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1141.828990] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1141.829183] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1141.857062] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 in Status: IN_PROGRESS for 2s [ 1142.619170] env[67094]: INFO networking_nsxv3.common.synchronization [req-107a1953-b753-4ab1-9612-1117e5f013a5 req-bb2decfe-6979-441f-8a26-5de8cee25ab2 tempest-ServerActionsTestJSON-785713127 tempest-ServerActionsTestJSON-785713127-project-member] Enqueued Resource ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 with Priority: HIGHEST for action security_group_members [ 1142.619555] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 with Priority: HIGHEST for action security_group_members [ 1142.619876] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-018c19d8-0b0e-41bd-8f01-0c9c58710c57 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.619997] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.620088] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.620289] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.620437] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1142.620580] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1142.620633] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1142.620776] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1142.620860] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1142.621102] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('018c19d8-0b0e-41bd-8f01-0c9c58710c57',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.095689] env[67094]: INFO networking_nsxv3.common.synchronization [req-14bf77c8-8c67-406b-95d0-618c83f538ea req-f7005c44-8032-435f-a541-f222126eeaab tempest-MultipleCreateTestJSON-360930871 tempest-MultipleCreateTestJSON-360930871-project-member] Enqueued Resource ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 with Priority: HIGHEST for action security_group_members [ 1143.096145] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 with Priority: HIGHEST for action security_group_members [ 1143.096513] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.096595] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.096663] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.096862] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.097017] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.097135] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.097204] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.097356] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.097455] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.097549] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.123733] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.123733] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.123733] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.123966] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.147876] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.148132] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.148281] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.148357] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.148962] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.148962] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.149755] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 is going to be updated. [ 1143.153382] env[67094]: INFO networking_nsxv3.common.synchronization [req-4b7d43fe-f12f-4014-a1b1-ebcd1f8c2fb6 req-bb6aafb3-2933-42f9-85ca-1043ebad002a tempest-MultipleCreateTestJSON-360930871 tempest-MultipleCreateTestJSON-360930871-project-member] Enqueued Resource ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 with Priority: HIGHEST for action security_group_members [ 1143.153888] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 with Priority: HIGHEST for action security_group_members [ 1143.154226] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.154331] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.183359] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1143.183486] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1143.183553] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.183806] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.183965] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.193248] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 in Status: IN_PROGRESS for 2s [ 1143.600146] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1143.869262] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 in Status: SUCCESS [ 1143.869542] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1143.869765] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1143.870044] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1143.870140] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.105354] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1144.395882] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.396108] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.396204] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.396415] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.396542] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.396671] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 is going to be deleted. [ 1144.464545] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.464545] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.464752] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.464846] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.464949] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.465051] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.608102] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.608343] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.608343] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.608808] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.608931] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.609070] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 is going to be updated. [ 1144.642081] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1144.642254] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1144.642313] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1144.642523] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1144.642671] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1144.656856] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 in Status: IN_PROGRESS for 2s [ 1145.204341] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 in Status: SUCCESS [ 1145.204637] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 deletion is rescheduled due to dependency. [ 1145.204637] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.743251] env[67094]: INFO networking_nsxv3.common.synchronization [req-3c203a2f-6fe5-43d4-a655-7ded1822b2ed req-a8cfbbb2-3fdb-42f7-97a9-d68de1364c81 tempest-AttachInterfacesTestJSON-1117082489 tempest-AttachInterfacesTestJSON-1117082489-project-member] Enqueued Resource ID: 8c8bcd5f-7602-4632-8046-daa41c621837 with Priority: HIGHEST for action security_group_members [ 1145.744174] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c8bcd5f-7602-4632-8046-daa41c621837 with Priority: HIGHEST for action security_group_members [ 1145.744524] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c8bcd5f-7602-4632-8046-daa41c621837 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.744745] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c8bcd5f-7602-4632-8046-daa41c621837" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.744845] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c8bcd5f-7602-4632-8046-daa41c621837" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.745079] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c8bcd5f-7602-4632-8046-daa41c621837" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.745246] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1145.745351] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1145.745414] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1145.745607] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1145.745667] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1145.745745] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c8bcd5f-7602-4632-8046-daa41c621837',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.247691] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8c8bcd5f-7602-4632-8046-daa41c621837',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.667383] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 in Status: SUCCESS [ 1146.667634] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.667835] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.668097] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.668458] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1146.668677] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1146.668677] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1146.668783] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1146.668832] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1146.668972] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1146.749948] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8c8bcd5f-7602-4632-8046-daa41c621837',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1147.171677] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.171842] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.171916] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.172176] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.172352] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.172580] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.172705] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.172801] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.173070] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.173157] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.173244] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 is going to be deleted. [ 1147.210780] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.211410] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.211410] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.211410] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.211410] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.211741] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.252260] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.252639] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.252639] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.252843] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.252969] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.253119] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c8bcd5f-7602-4632-8046-daa41c621837 is going to be updated. [ 1147.282262] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1147.283383] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1147.283383] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1147.283383] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1147.283383] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1147.294634] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c8bcd5f-7602-4632-8046-daa41c621837 in Status: IN_PROGRESS for 2s [ 1149.307299] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c8bcd5f-7602-4632-8046-daa41c621837 in Status: SUCCESS [ 1149.307703] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c8bcd5f-7602-4632-8046-daa41c621837" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1150.745557] env[67094]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1150.745954] env[67094]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1154.234776] env[67094]: INFO networking_nsxv3.common.synchronization [None req-1ff69116-2d4b-486b-9158-7d8ed9c4ad83 tempest-AttachVolumeNegativeTest-737516548 tempest-AttachVolumeNegativeTest-737516548-project-member] Enqueued Resource ID: fb2958aa-150f-4e44-b88a-573295ac9a32 with Priority: HIGHEST for action security_group_rules [ 1154.237452] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb2958aa-150f-4e44-b88a-573295ac9a32 with Priority: HIGHEST for action security_group_rules [ 1154.238030] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb2958aa-150f-4e44-b88a-573295ac9a32 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.238725] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb2958aa-150f-4e44-b88a-573295ac9a32" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.238725] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb2958aa-150f-4e44-b88a-573295ac9a32" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.238837] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb2958aa-150f-4e44-b88a-573295ac9a32" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.238880] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb2958aa-150f-4e44-b88a-573295ac9a32',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.312688] env[67094]: INFO networking_nsxv3.common.synchronization [None req-11bf8a04-283c-474a-b243-517bee147348 tempest-AttachVolumeNegativeTest-737516548 tempest-AttachVolumeNegativeTest-737516548-project-member] Enqueued Resource ID: fb2958aa-150f-4e44-b88a-573295ac9a32 with Priority: HIGHEST for action security_group_rules [ 1154.313253] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb2958aa-150f-4e44-b88a-573295ac9a32 with Priority: HIGHEST for action security_group_rules [ 1154.313567] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb2958aa-150f-4e44-b88a-573295ac9a32 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.313690] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb2958aa-150f-4e44-b88a-573295ac9a32" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.362907] env[67094]: INFO networking_nsxv3.common.synchronization [req-7f5c547f-2e6d-4a4d-9a27-3947a0c81bbc req-90043856-a6f2-40e0-bfe5-dbce80a75b40 tempest-ServerActionsTestOtherA-276518123 tempest-ServerActionsTestOtherA-276518123-project-member] Enqueued Resource ID: 6745d4e2-6069-4132-80d9-76cf2245b017 with Priority: HIGHEST for action security_group_members [ 1154.363474] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6745d4e2-6069-4132-80d9-76cf2245b017 with Priority: HIGHEST for action security_group_members [ 1154.363784] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-6745d4e2-6069-4132-80d9-76cf2245b017 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.363905] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6745d4e2-6069-4132-80d9-76cf2245b017" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.363973] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6745d4e2-6069-4132-80d9-76cf2245b017" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.364448] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6745d4e2-6069-4132-80d9-76cf2245b017" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.364609] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.364712] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.364777] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.364933] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.365028] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.365122] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6745d4e2-6069-4132-80d9-76cf2245b017',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.718292] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock network-997 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.718505] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "network-997" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.718635] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "network-997" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.718943] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "network-997" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.719225] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.719453] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.719520] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.719801] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.719867] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.720071] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1154.720187] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1154.720295] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1154.720401] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1154.720510] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1154.720666] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1154.720812] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1154.741237] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1154.742051] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Cache value generated in 0.021 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1154.742051] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1154.742051] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "network-997" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.742218] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock port-b224bcda-72ac-46ab-8c89-28521f14d94b taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.742302] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "port-b224bcda-72ac-46ab-8c89-28521f14d94b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.742433] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "port-b224bcda-72ac-46ab-8c89-28521f14d94b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.742813] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "port-b224bcda-72ac-46ab-8c89-28521f14d94b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.742961] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b224bcda-72ac-46ab-8c89-28521f14d94b',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.765372] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.765372] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.765372] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.765372] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.765372] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.765372] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb2958aa-150f-4e44-b88a-573295ac9a32 already deleted. [ 1154.765372] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb2958aa-150f-4e44-b88a-573295ac9a32" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.765744] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb2958aa-150f-4e44-b88a-573295ac9a32" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.765744] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb2958aa-150f-4e44-b88a-573295ac9a32" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.765820] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb2958aa-150f-4e44-b88a-573295ac9a32',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1154.869571] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.869730] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.869730] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.870032] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.870173] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.870418] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.870524] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.870658] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.870868] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.870954] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.871063] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6745d4e2-6069-4132-80d9-76cf2245b017 is going to be deleted. [ 1154.907479] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1154.907479] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1154.907479] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1154.907479] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1154.907479] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1154.907479] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6745d4e2-6069-4132-80d9-76cf2245b017" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.246098] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.246098] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.246098] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.246567] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.246567] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.246868] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Segment Port b224bcda-72ac-46ab-8c89-28521f14d94b not found, creating... [ 1155.246868] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.247045] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.247170] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.247395] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.247534] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.247864] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.248076] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.248200] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.248415] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.248589] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.248694] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Resource: SegmentPort with ID: b224bcda-72ac-46ab-8c89-28521f14d94b is going to be created. [ 1155.299693] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.299943] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.300115] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.300524] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.300945] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.301101] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "port-b224bcda-72ac-46ab-8c89-28521f14d94b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.304106] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1155.304106] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1155.304106] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1155.304106] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1155.304106] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1155.304106] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb2958aa-150f-4e44-b88a-573295ac9a32 already deleted. [ 1155.304106] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb2958aa-150f-4e44-b88a-573295ac9a32" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.001904] env[67094]: INFO networking_nsxv3.common.synchronization [req-7f5c547f-2e6d-4a4d-9a27-3947a0c81bbc req-c4dc9870-4977-4334-802d-bb5e07f3e176 service nova] Enqueued Resource ID: 6745d4e2-6069-4132-80d9-76cf2245b017 with Priority: HIGHEST for action security_group_rules [ 1156.001904] env[67094]: INFO networking_nsxv3.common.synchronization [req-7f5c547f-2e6d-4a4d-9a27-3947a0c81bbc req-c4dc9870-4977-4334-802d-bb5e07f3e176 service nova] Enqueued Resource ID: 6745d4e2-6069-4132-80d9-76cf2245b017 with Priority: HIGHEST for action security_group_members [ 1156.001904] env[67094]: INFO networking_nsxv3.common.synchronization [req-7f5c547f-2e6d-4a4d-9a27-3947a0c81bbc req-c4dc9870-4977-4334-802d-bb5e07f3e176 service nova] Enqueued Resource ID: b224bcda-72ac-46ab-8c89-28521f14d94b with Priority: HIGHEST for action port [ 1156.002468] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6745d4e2-6069-4132-80d9-76cf2245b017 with Priority: HIGHEST for action security_group_rules [ 1156.002542] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6745d4e2-6069-4132-80d9-76cf2245b017 with Priority: HIGHEST for action security_group_members [ 1156.002581] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b224bcda-72ac-46ab-8c89-28521f14d94b with Priority: HIGHEST for action port [ 1156.002839] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6745d4e2-6069-4132-80d9-76cf2245b017 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.002967] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6745d4e2-6069-4132-80d9-76cf2245b017" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.003189] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6745d4e2-6069-4132-80d9-76cf2245b017" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.003422] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6745d4e2-6069-4132-80d9-76cf2245b017" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.003477] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6745d4e2-6069-4132-80d9-76cf2245b017',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.005194] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-6745d4e2-6069-4132-80d9-76cf2245b017 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.005194] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6745d4e2-6069-4132-80d9-76cf2245b017" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.005194] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6745d4e2-6069-4132-80d9-76cf2245b017" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.005358] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6745d4e2-6069-4132-80d9-76cf2245b017" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.005567] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.005637] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.005728] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.005800] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.005886] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.005969] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6745d4e2-6069-4132-80d9-76cf2245b017',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.007546] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-b224bcda-72ac-46ab-8c89-28521f14d94b taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.009554] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b224bcda-72ac-46ab-8c89-28521f14d94b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.009554] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b224bcda-72ac-46ab-8c89-28521f14d94b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.009554] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b224bcda-72ac-46ab-8c89-28521f14d94b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.009554] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b224bcda-72ac-46ab-8c89-28521f14d94b',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.505810] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-6745d4e2-6069-4132-80d9-76cf2245b017 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.506206] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6745d4e2-6069-4132-80d9-76cf2245b017" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.508374] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('6745d4e2-6069-4132-80d9-76cf2245b017',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1156.509881] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b224bcda-72ac-46ab-8c89-28521f14d94b with status ACTIVE [ 1156.510151] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.510288] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.510357] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.510602] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.510687] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.511244] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.511244] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.511244] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.511244] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.511472] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.511556] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.511650] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.511692] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.511854] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.511937] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.512035] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b224bcda-72ac-46ab-8c89-28521f14d94b is going to be updated. [ 1156.535043] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1156.535213] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1156.535261] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1156.535833] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1156.535833] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1156.535833] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b224bcda-72ac-46ab-8c89-28521f14d94b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.011412] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('6745d4e2-6069-4132-80d9-76cf2245b017',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.226848] env[67094]: INFO networking_nsxv3.common.synchronization [req-662b0944-7a33-4f1e-9f55-4fe6177d52e8 req-ed08dbec-0809-4668-81e7-9a8836d2d66d tempest-DeleteServersTestJSON-1237946437 tempest-DeleteServersTestJSON-1237946437-project-member] Enqueued Resource ID: 276c2084-ac8d-475a-af24-a062dc3e17aa with Priority: HIGHEST for action security_group_members [ 1157.227791] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 276c2084-ac8d-475a-af24-a062dc3e17aa with Priority: HIGHEST for action security_group_members [ 1157.228431] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-276c2084-ac8d-475a-af24-a062dc3e17aa taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.228592] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.228666] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.228887] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.229067] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.229174] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.229238] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.229397] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.229483] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.229614] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('276c2084-ac8d-475a-af24-a062dc3e17aa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1157.515212] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.515481] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.515481] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.515657] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.515752] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.515849] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6745d4e2-6069-4132-80d9-76cf2245b017 is going to be created. [ 1157.553311] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.553453] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.553533] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.553793] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.553964] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.563653] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6745d4e2-6069-4132-80d9-76cf2245b017 in Status: UNINITIALIZED for 2s [ 1157.732534] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.732764] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.732857] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.733103] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.733199] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.733418] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.733533] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.733602] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.733762] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.733836] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.733927] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 276c2084-ac8d-475a-af24-a062dc3e17aa is going to be updated. [ 1157.769143] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1157.769345] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1157.769345] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1157.769521] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1157.769659] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1157.783966] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 276c2084-ac8d-475a-af24-a062dc3e17aa in Status: IN_PROGRESS for 2s [ 1159.574206] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6745d4e2-6069-4132-80d9-76cf2245b017 in Status: SUCCESS [ 1159.574579] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6745d4e2-6069-4132-80d9-76cf2245b017" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.574779] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6745d4e2-6069-4132-80d9-76cf2245b017" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.575011] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6745d4e2-6069-4132-80d9-76cf2245b017" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.575333] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1159.575541] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1159.575668] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1159.575918] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1159.576121] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.576318] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6745d4e2-6069-4132-80d9-76cf2245b017" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1159.576470] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('6745d4e2-6069-4132-80d9-76cf2245b017',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1159.796147] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 276c2084-ac8d-475a-af24-a062dc3e17aa in Status: SUCCESS [ 1159.796147] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 276c2084-ac8d-475a-af24-a062dc3e17aa deletion is rescheduled due to dependency. [ 1159.796936] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.080038] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-6745d4e2-6069-4132-80d9-76cf2245b017 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.080038] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6745d4e2-6069-4132-80d9-76cf2245b017" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.080038] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6745d4e2-6069-4132-80d9-76cf2245b017" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.080306] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6745d4e2-6069-4132-80d9-76cf2245b017" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.080306] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.080401] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.080482] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.080690] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.080862] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.080907] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6745d4e2-6069-4132-80d9-76cf2245b017" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.081046] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-6745d4e2-6069-4132-80d9-76cf2245b017 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.081163] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6745d4e2-6069-4132-80d9-76cf2245b017" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.081227] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6745d4e2-6069-4132-80d9-76cf2245b017" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.081380] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6745d4e2-6069-4132-80d9-76cf2245b017" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.081542] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.081638] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.081703] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.081860] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.081938] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.082031] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6745d4e2-6069-4132-80d9-76cf2245b017" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.082137] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('6745d4e2-6069-4132-80d9-76cf2245b017',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.584980] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 6745d4e2-6069-4132-80d9-76cf2245b017: rpc.has_security_group_logging(os_id): False [ 1160.615361] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.615652] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.615729] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.615941] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.616082] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.616240] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.616355] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.616494] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.616544] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.616603] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.616888] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.616995] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.617107] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.617286] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.617397] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.617637] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.617738] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.617798] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.618015] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.618093] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.618236] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6745d4e2-6069-4132-80d9-76cf2245b017 is going to be created. [ 1160.654352] env[67094]: INFO networking_nsxv3.common.synchronization [req-5379e276-0f45-4376-a6c9-d5c57765ed8c req-210f5b94-da79-4b0d-b01d-151157cc25eb tempest-AttachInterfacesTestJSON-1117082489 tempest-AttachInterfacesTestJSON-1117082489-project-member] Enqueued Resource ID: 8c8bcd5f-7602-4632-8046-daa41c621837 with Priority: HIGHEST for action security_group_members [ 1160.655103] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c8bcd5f-7602-4632-8046-daa41c621837 with Priority: HIGHEST for action security_group_members [ 1160.655427] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-8c8bcd5f-7602-4632-8046-daa41c621837 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.655569] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8c8bcd5f-7602-4632-8046-daa41c621837" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.655569] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8c8bcd5f-7602-4632-8046-daa41c621837" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.655569] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8c8bcd5f-7602-4632-8046-daa41c621837" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.656083] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.656083] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.656083] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.656311] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.656373] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.656621] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8c8bcd5f-7602-4632-8046-daa41c621837',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1160.703367] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1160.703550] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1160.703629] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1160.703999] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1160.704229] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1160.732801] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6745d4e2-6069-4132-80d9-76cf2245b017 in Status: IN_PROGRESS for 2s [ 1161.158854] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.159126] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.159226] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.159552] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.159717] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.160053] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.160209] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.160308] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.160568] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.160726] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.160877] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c8bcd5f-7602-4632-8046-daa41c621837 is going to be updated. [ 1161.201622] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1161.201800] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1161.201967] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1161.202248] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1161.202509] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1161.217319] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c8bcd5f-7602-4632-8046-daa41c621837 in Status: IN_PROGRESS for 2s [ 1162.748835] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 6745d4e2-6069-4132-80d9-76cf2245b017 in Status: SUCCESS [ 1162.749197] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6745d4e2-6069-4132-80d9-76cf2245b017" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.043970] env[67094]: INFO networking_nsxv3.common.synchronization [req-b177888a-8360-4055-98e7-631e45cadd55 req-70678f35-cd2d-40c2-9a98-c9db5d200f25 tempest-ServerActionsTestJSON-785713127 tempest-ServerActionsTestJSON-785713127-project-member] Enqueued Resource ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 with Priority: HIGHEST for action security_group_members [ 1163.044630] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 with Priority: HIGHEST for action security_group_members [ 1163.044968] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-018c19d8-0b0e-41bd-8f01-0c9c58710c57 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.046265] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.046265] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.046868] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.047158] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.047370] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.047528] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.047814] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.047977] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.048139] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('018c19d8-0b0e-41bd-8f01-0c9c58710c57',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.229222] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c8bcd5f-7602-4632-8046-daa41c621837 in Status: IN_PROGRESS for 4s [ 1163.397954] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock network-657 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.398172] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "network-657" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.398340] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "network-657" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.399028] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "network-657" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.399229] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.399434] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.399559] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.399806] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.399957] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.400181] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1163.400295] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1163.400403] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1163.400688] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1163.400688] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1163.400806] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1163.400941] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1163.420171] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1163.420433] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1163.420582] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1163.420806] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "network-657" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.421343] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock port-ce0c691f-b5fa-46b2-b326-8df4a7a2a88d taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.421343] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "port-ce0c691f-b5fa-46b2-b326-8df4a7a2a88d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.421533] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "port-ce0c691f-b5fa-46b2-b326-8df4a7a2a88d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.421771] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "port-ce0c691f-b5fa-46b2-b326-8df4a7a2a88d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.421906] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce0c691f-b5fa-46b2-b326-8df4a7a2a88d',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1163.551924] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.552113] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.552177] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.552392] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.552480] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.552680] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.552780] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.552844] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.553031] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.553136] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.553227] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 is going to be updated. [ 1163.581048] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.581048] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.581048] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.581048] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.581303] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.590630] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 in Status: IN_PROGRESS for 2s [ 1163.925821] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.925821] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.925821] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.925821] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.925821] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.925821] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Segment Port ce0c691f-b5fa-46b2-b326-8df4a7a2a88d not found, creating... [ 1163.925821] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.926531] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.926531] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.926531] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.926531] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.926674] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.926825] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.926940] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.927151] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.927296] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.927431] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Resource: SegmentPort with ID: ce0c691f-b5fa-46b2-b326-8df4a7a2a88d is going to be created. [ 1163.947699] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1163.948031] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1163.948072] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1163.948330] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1163.948558] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1163.948767] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "port-ce0c691f-b5fa-46b2-b326-8df4a7a2a88d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.479094] env[67094]: INFO networking_nsxv3.common.synchronization [req-5f28d4b0-54b9-4d8e-881a-e5ec0489c637 req-d0762d5a-005b-492b-bb1d-2da4e95e4c64 tempest-ServerActionsTestOtherA-276518123 tempest-ServerActionsTestOtherA-276518123-project-member] Enqueued Resource ID: 6745d4e2-6069-4132-80d9-76cf2245b017 with Priority: HIGHEST for action security_group_members [ 1164.479626] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6745d4e2-6069-4132-80d9-76cf2245b017 with Priority: HIGHEST for action security_group_members [ 1164.480172] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-6745d4e2-6069-4132-80d9-76cf2245b017 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.480172] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-6745d4e2-6069-4132-80d9-76cf2245b017" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.480172] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-6745d4e2-6069-4132-80d9-76cf2245b017" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.480438] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-6745d4e2-6069-4132-80d9-76cf2245b017" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.480494] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.481714] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.481714] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.481714] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.481714] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.481714] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('6745d4e2-6069-4132-80d9-76cf2245b017',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.532039] env[67094]: INFO networking_nsxv3.common.synchronization [req-5f28d4b0-54b9-4d8e-881a-e5ec0489c637 req-d0762d5a-005b-492b-bb1d-2da4e95e4c64 tempest-ServerActionsTestOtherA-276518123 tempest-ServerActionsTestOtherA-276518123-project-member] Enqueued Resource ID: b224bcda-72ac-46ab-8c89-28521f14d94b with Priority: HIGHEST for action port [ 1164.532039] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b224bcda-72ac-46ab-8c89-28521f14d94b with Priority: HIGHEST for action port [ 1164.532039] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-b224bcda-72ac-46ab-8c89-28521f14d94b taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.532039] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-b224bcda-72ac-46ab-8c89-28521f14d94b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.532039] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-b224bcda-72ac-46ab-8c89-28521f14d94b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.532334] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-b224bcda-72ac-46ab-8c89-28521f14d94b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.532334] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('b224bcda-72ac-46ab-8c89-28521f14d94b',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.674083] env[67094]: INFO networking_nsxv3.common.synchronization [req-b177888a-8360-4055-98e7-631e45cadd55 req-96d0c239-87c5-4c79-aed2-dc684f7a59b1 service nova] Enqueued Resource ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 with Priority: HIGHEST for action security_group_rules [ 1164.674083] env[67094]: INFO networking_nsxv3.common.synchronization [req-b177888a-8360-4055-98e7-631e45cadd55 req-96d0c239-87c5-4c79-aed2-dc684f7a59b1 service nova] Enqueued Resource ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 with Priority: HIGHEST for action security_group_members [ 1164.674083] env[67094]: INFO networking_nsxv3.common.synchronization [req-b177888a-8360-4055-98e7-631e45cadd55 req-96d0c239-87c5-4c79-aed2-dc684f7a59b1 service nova] Enqueued Resource ID: ce0c691f-b5fa-46b2-b326-8df4a7a2a88d with Priority: HIGHEST for action port [ 1164.674467] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 with Priority: HIGHEST for action security_group_rules [ 1164.674603] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 with Priority: HIGHEST for action security_group_members [ 1164.674700] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: ce0c691f-b5fa-46b2-b326-8df4a7a2a88d with Priority: HIGHEST for action port [ 1164.674966] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-018c19d8-0b0e-41bd-8f01-0c9c58710c57 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.675100] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.675167] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.675364] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.675435] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('018c19d8-0b0e-41bd-8f01-0c9c58710c57',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.676278] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-018c19d8-0b0e-41bd-8f01-0c9c58710c57 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.676399] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.676565] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-ce0c691f-b5fa-46b2-b326-8df4a7a2a88d taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.676726] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-ce0c691f-b5fa-46b2-b326-8df4a7a2a88d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.676766] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-ce0c691f-b5fa-46b2-b326-8df4a7a2a88d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.676916] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-ce0c691f-b5fa-46b2-b326-8df4a7a2a88d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.676992] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('ce0c691f-b5fa-46b2-b326-8df4a7a2a88d',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1164.983033] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.983347] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.983347] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.983544] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.983544] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.983732] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1164.983833] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1164.983895] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1164.984051] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1164.984120] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1164.984206] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6745d4e2-6069-4132-80d9-76cf2245b017 is going to be updated. [ 1165.011744] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.011935] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.011993] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.013061] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.013061] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.022211] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6745d4e2-6069-4132-80d9-76cf2245b017 in Status: IN_PROGRESS for 2s [ 1165.036102] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port b224bcda-72ac-46ab-8c89-28521f14d94b with status ACTIVE [ 1165.036102] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.036299] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.036355] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.036572] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.036663] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.036837] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.036939] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.037741] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.037741] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.037741] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.037741] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.037741] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.037741] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.037741] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.038074] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.038074] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: b224bcda-72ac-46ab-8c89-28521f14d94b is going to be updated. [ 1165.059618] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.060256] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.060256] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.060549] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.060751] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.061023] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-b224bcda-72ac-46ab-8c89-28521f14d94b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.179926] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-018c19d8-0b0e-41bd-8f01-0c9c58710c57 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.180230] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.182517] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port ce0c691f-b5fa-46b2-b326-8df4a7a2a88d with status ACTIVE [ 1165.182745] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.182909] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.182976] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.183252] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.183288] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.183472] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.183575] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.183639] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.183808] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.183876] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.184066] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.184159] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.184223] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.184363] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.184437] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.184522] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: ce0c691f-b5fa-46b2-b326-8df4a7a2a88d is going to be updated. [ 1165.214693] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.214833] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.214912] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.215148] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.215286] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.215481] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-ce0c691f-b5fa-46b2-b326-8df4a7a2a88d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.245257] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8c8bcd5f-7602-4632-8046-daa41c621837 in Status: SUCCESS [ 1165.245830] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8c8bcd5f-7602-4632-8046-daa41c621837 deletion is rescheduled due to dependency. [ 1165.245830] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8c8bcd5f-7602-4632-8046-daa41c621837" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.385460] env[67094]: INFO networking_nsxv3.common.synchronization [req-01949070-a81a-41a9-a9fb-8af14d241f07 req-ef9e494b-9f7e-4896-9429-55f3496a88bf tempest-MultipleCreateTestJSON-360930871 tempest-MultipleCreateTestJSON-360930871-project-member] Enqueued Resource ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 with Priority: HIGHEST for action security_group_members [ 1165.386045] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 with Priority: HIGHEST for action security_group_members [ 1165.386361] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.386484] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.386552] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.386749] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.386908] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.387013] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.387527] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.387711] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.387905] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.388025] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.600697] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 in Status: SUCCESS [ 1165.600943] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 deletion is rescheduled due to dependency. [ 1165.601074] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.601244] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.601668] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.601668] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.601827] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.602280] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.602280] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.602280] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.602467] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('018c19d8-0b0e-41bd-8f01-0c9c58710c57',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.740145] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock network-785 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.740331] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "network-785" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.740460] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "network-785" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.740760] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "network-785" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.741068] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.741235] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.741388] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.741603] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.741765] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.741969] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1165.742095] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1165.742205] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1165.742323] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1165.742469] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1165.742579] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1165.742714] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1165.767341] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1165.767432] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1165.767640] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1165.768151] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "network-785" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.768408] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock port-8babea78-a5b1-48cb-9b5d-81d38aa415e3 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.768595] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "port-8babea78-a5b1-48cb-9b5d-81d38aa415e3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.769078] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "port-8babea78-a5b1-48cb-9b5d-81d38aa415e3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.769078] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "port-8babea78-a5b1-48cb-9b5d-81d38aa415e3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.769201] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8babea78-a5b1-48cb-9b5d-81d38aa415e3',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1165.891134] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.891475] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.891594] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.891973] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.892149] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.892483] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1165.892680] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1165.892789] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1165.893073] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1165.893203] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1165.893313] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 already deleted. [ 1165.893437] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.105878] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('018c19d8-0b0e-41bd-8f01-0c9c58710c57',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.272269] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.272591] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.272758] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.273084] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.273246] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.273407] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Segment Port 8babea78-a5b1-48cb-9b5d-81d38aa415e3 not found, creating... [ 1166.273677] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.273842] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.273964] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.274203] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.274342] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.274624] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.274781] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.274900] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.275114] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.275249] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.275461] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Resource: SegmentPort with ID: 8babea78-a5b1-48cb-9b5d-81d38aa415e3 is going to be created. [ 1166.296440] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.296652] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.296777] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.297092] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.297325] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.297550] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "port-8babea78-a5b1-48cb-9b5d-81d38aa415e3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.609553] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('018c19d8-0b0e-41bd-8f01-0c9c58710c57',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.983022] env[67094]: INFO networking_nsxv3.common.synchronization [req-01949070-a81a-41a9-a9fb-8af14d241f07 req-7fdee23e-d9c9-4ce8-80ed-133369b624b8 service nova] Enqueued Resource ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 with Priority: HIGHEST for action security_group_rules [ 1166.983022] env[67094]: INFO networking_nsxv3.common.synchronization [req-01949070-a81a-41a9-a9fb-8af14d241f07 req-7fdee23e-d9c9-4ce8-80ed-133369b624b8 service nova] Enqueued Resource ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 with Priority: HIGHEST for action security_group_members [ 1166.983022] env[67094]: INFO networking_nsxv3.common.synchronization [req-01949070-a81a-41a9-a9fb-8af14d241f07 req-7fdee23e-d9c9-4ce8-80ed-133369b624b8 service nova] Enqueued Resource ID: 8babea78-a5b1-48cb-9b5d-81d38aa415e3 with Priority: HIGHEST for action port [ 1166.983022] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 with Priority: HIGHEST for action security_group_rules [ 1166.983022] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 with Priority: HIGHEST for action security_group_members [ 1166.983022] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8babea78-a5b1-48cb-9b5d-81d38aa415e3 with Priority: HIGHEST for action port [ 1166.983370] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.983450] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.983580] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.983689] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.983766] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.984617] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.984755] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.984816] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.984936] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.985105] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.985195] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.985258] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.985397] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.985475] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1166.985556] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1166.987772] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-8babea78-a5b1-48cb-9b5d-81d38aa415e3 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1166.988358] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-8babea78-a5b1-48cb-9b5d-81d38aa415e3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1166.988481] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-8babea78-a5b1-48cb-9b5d-81d38aa415e3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1166.988678] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-8babea78-a5b1-48cb-9b5d-81d38aa415e3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1166.988780] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('8babea78-a5b1-48cb-9b5d-81d38aa415e3',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.034326] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 6745d4e2-6069-4132-80d9-76cf2245b017 in Status: SUCCESS [ 1167.034546] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 6745d4e2-6069-4132-80d9-76cf2245b017 deletion is rescheduled due to dependency. [ 1167.034668] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-6745d4e2-6069-4132-80d9-76cf2245b017" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.112904] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.113336] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.113336] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.113518] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.113665] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.113797] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 is going to be updated. [ 1167.146232] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.146415] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.146455] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.146665] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.146815] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.156459] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 in Status: IN_PROGRESS for 2s [ 1167.491251] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 8babea78-a5b1-48cb-9b5d-81d38aa415e3 with status ACTIVE [ 1167.491434] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.491434] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.494362] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.494657] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.494781] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.494993] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.495123] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.495179] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.495333] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.495409] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.495588] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.495671] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.495723] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.495858] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.495930] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.496023] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 8babea78-a5b1-48cb-9b5d-81d38aa415e3 is going to be updated. [ 1167.497539] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.497539] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.497728] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1167.523271] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.523271] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.523271] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.523271] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.523271] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.523461] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-8babea78-a5b1-48cb-9b5d-81d38aa415e3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.657650] env[67094]: INFO networking_nsxv3.common.synchronization [req-01949070-a81a-41a9-a9fb-8af14d241f07 req-7781183d-8dfe-4cff-ab4c-03d5c2572eb3 tempest-MultipleCreateTestJSON-360930871 tempest-MultipleCreateTestJSON-360930871-project-member] Enqueued Resource ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 with Priority: HIGHEST for action security_group_members [ 1167.658509] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 with Priority: HIGHEST for action security_group_members [ 1167.658832] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.658936] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.951290] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock network-785 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.951410] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "network-785" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.951450] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "network-785" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.951705] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "network-785" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.952018] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.952187] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.952307] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.952529] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.952680] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.952890] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1167.953092] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1167.953158] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1167.953317] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1167.953445] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1167.953554] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1167.953703] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1167.981163] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1167.981338] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Cache value generated in 0.028 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1167.981480] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1167.981653] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "network-785" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1167.982042] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock port-17319f85-bd59-45cb-a866-507b0527c80b taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1167.982213] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "port-17319f85-bd59-45cb-a866-507b0527c80b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1167.982333] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "port-17319f85-bd59-45cb-a866-507b0527c80b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1167.982651] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "port-17319f85-bd59-45cb-a866-507b0527c80b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1167.982792] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('17319f85-bd59-45cb-a866-507b0527c80b',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.003913] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1168.485640] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.486060] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.486060] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.486375] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.486547] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.486704] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Segment Port 17319f85-bd59-45cb-a866-507b0527c80b not found, creating... [ 1168.486982] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.487160] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.487293] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.487538] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.487677] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.487968] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.488139] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.488257] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.488484] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.488629] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.488799] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Resource: SegmentPort with ID: 17319f85-bd59-45cb-a866-507b0527c80b is going to be created. [ 1168.507100] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.507403] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.507482] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.507715] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.507828] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.508095] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 is going to be created. [ 1168.513204] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.513204] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.513204] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.513533] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.513988] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.514129] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "port-17319f85-bd59-45cb-a866-507b0527c80b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.553217] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1168.553455] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1168.553523] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1168.553777] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1168.554148] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1168.579651] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 in Status: UNINITIALIZED for 2s [ 1169.167020] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 in Status: SUCCESS [ 1169.167279] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.167445] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.167659] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.167850] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.167968] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.168121] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.168195] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.168273] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.168355] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.168526] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('018c19d8-0b0e-41bd-8f01-0c9c58710c57',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.207101] env[67094]: INFO networking_nsxv3.common.synchronization [req-01949070-a81a-41a9-a9fb-8af14d241f07 req-cdc82d6d-6e94-42d3-bbc3-3d6bc07d183f service nova] Enqueued Resource ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 with Priority: HIGHEST for action security_group_rules [ 1169.207251] env[67094]: INFO networking_nsxv3.common.synchronization [req-01949070-a81a-41a9-a9fb-8af14d241f07 req-cdc82d6d-6e94-42d3-bbc3-3d6bc07d183f service nova] Enqueued Resource ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 with Priority: HIGHEST for action security_group_members [ 1169.207392] env[67094]: INFO networking_nsxv3.common.synchronization [req-01949070-a81a-41a9-a9fb-8af14d241f07 req-cdc82d6d-6e94-42d3-bbc3-3d6bc07d183f service nova] Enqueued Resource ID: 17319f85-bd59-45cb-a866-507b0527c80b with Priority: HIGHEST for action port [ 1169.207897] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 with Priority: HIGHEST for action security_group_rules [ 1169.208052] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 with Priority: HIGHEST for action security_group_members [ 1169.208199] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 17319f85-bd59-45cb-a866-507b0527c80b with Priority: HIGHEST for action port [ 1169.208453] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.208524] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.208710] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.208787] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.208972] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-17319f85-bd59-45cb-a866-507b0527c80b taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.209096] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-17319f85-bd59-45cb-a866-507b0527c80b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.209158] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-17319f85-bd59-45cb-a866-507b0527c80b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.209371] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-17319f85-bd59-45cb-a866-507b0527c80b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.209498] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('17319f85-bd59-45cb-a866-507b0527c80b',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.671138] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('018c19d8-0b0e-41bd-8f01-0c9c58710c57',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1169.711605] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 17319f85-bd59-45cb-a866-507b0527c80b with status ACTIVE [ 1169.712013] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.712220] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.712324] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.712634] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.712759] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.713031] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.713191] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.713383] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.713507] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.713625] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.713910] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.714074] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.714170] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.714378] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.714496] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.714632] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 17319f85-bd59-45cb-a866-507b0527c80b is going to be updated. [ 1169.742748] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1169.742887] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1169.742887] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1169.743129] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1169.743279] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1169.743447] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-17319f85-bd59-45cb-a866-507b0527c80b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.048306] env[67094]: INFO networking_nsxv3.common.synchronization [req-ca0d8536-3396-4552-859d-4b1d23f1b945 req-b21b77ce-6edc-4b84-931c-4691fb9f5f28 tempest-AttachVolumeNegativeTest-737516548 tempest-AttachVolumeNegativeTest-737516548-project-member] Enqueued Resource ID: fb2958aa-150f-4e44-b88a-573295ac9a32 with Priority: HIGHEST for action security_group_members [ 1170.048306] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb2958aa-150f-4e44-b88a-573295ac9a32 with Priority: HIGHEST for action security_group_members [ 1170.048306] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb2958aa-150f-4e44-b88a-573295ac9a32 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.048306] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb2958aa-150f-4e44-b88a-573295ac9a32" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.048306] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb2958aa-150f-4e44-b88a-573295ac9a32" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.048306] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb2958aa-150f-4e44-b88a-573295ac9a32" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.048306] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.048981] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.048981] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.048981] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.048981] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.048981] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb2958aa-150f-4e44-b88a-573295ac9a32',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.173234] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 018c19d8-0b0e-41bd-8f01-0c9c58710c57: rpc.has_security_group_logging(os_id): False [ 1170.190847] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.191078] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.191078] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.191328] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.191440] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.191642] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.191744] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.191804] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.191962] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.192050] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.192138] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 is going to be updated. [ 1170.261058] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.261264] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.261264] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.261508] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.261699] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.275817] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 in Status: IN_PROGRESS for 2s [ 1170.401865] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock network-871 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.402108] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "network-871" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.402237] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "network-871" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.402878] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "network-871" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.403191] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.403357] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.403474] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.403695] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.403843] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.404113] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1170.404310] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1170.404360] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1170.404434] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1170.404553] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1170.404686] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1170.404826] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1170.430565] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1170.430565] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Cache value generated in 0.026 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1170.430720] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1170.430912] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "network-871" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.431255] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock port-52b85252-ce7d-4ebd-99f9-296e723a90d5 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.431435] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "port-52b85252-ce7d-4ebd-99f9-296e723a90d5" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.431552] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "port-52b85252-ce7d-4ebd-99f9-296e723a90d5" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.432733] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "port-52b85252-ce7d-4ebd-99f9-296e723a90d5" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.432733] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52b85252-ce7d-4ebd-99f9-296e723a90d5',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.550634] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.552017] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.552017] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.552017] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.552017] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.552017] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.552271] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.552271] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.552333] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.552361] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.552460] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb2958aa-150f-4e44-b88a-573295ac9a32 already deleted. [ 1170.552508] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb2958aa-150f-4e44-b88a-573295ac9a32" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.591891] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 in Status: SUCCESS [ 1170.592172] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.592328] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.592574] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.592769] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.592902] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.592985] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.593209] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.593325] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.593454] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.593612] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.595596] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.595596] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.595596] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.595596] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.595596] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.596066] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.596066] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.596066] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1170.935122] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.935122] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.935519] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.935584] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.935753] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.935935] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Segment Port 52b85252-ce7d-4ebd-99f9-296e723a90d5 not found, creating... [ 1170.936235] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.936401] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.936514] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.936752] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.936954] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.937220] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.937347] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.937438] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.937649] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.937769] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.937904] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Resource: SegmentPort with ID: 52b85252-ce7d-4ebd-99f9-296e723a90d5 is going to be created. [ 1170.962768] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1170.962991] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1170.963130] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1170.963413] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1170.963642] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1170.963895] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "port-52b85252-ce7d-4ebd-99f9-296e723a90d5" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.095721] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.096021] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.098482] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.600824] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.675913] env[67094]: INFO networking_nsxv3.common.synchronization [req-ca0d8536-3396-4552-859d-4b1d23f1b945 req-1f0efedb-01a8-4bd2-99b1-10ec5d2412a1 service nova] Enqueued Resource ID: fb2958aa-150f-4e44-b88a-573295ac9a32 with Priority: HIGHEST for action security_group_rules [ 1171.676117] env[67094]: INFO networking_nsxv3.common.synchronization [req-ca0d8536-3396-4552-859d-4b1d23f1b945 req-1f0efedb-01a8-4bd2-99b1-10ec5d2412a1 service nova] Enqueued Resource ID: fb2958aa-150f-4e44-b88a-573295ac9a32 with Priority: HIGHEST for action security_group_members [ 1171.676252] env[67094]: INFO networking_nsxv3.common.synchronization [req-ca0d8536-3396-4552-859d-4b1d23f1b945 req-1f0efedb-01a8-4bd2-99b1-10ec5d2412a1 service nova] Enqueued Resource ID: 52b85252-ce7d-4ebd-99f9-296e723a90d5 with Priority: HIGHEST for action port [ 1171.676831] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb2958aa-150f-4e44-b88a-573295ac9a32 with Priority: HIGHEST for action security_group_rules [ 1171.678135] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb2958aa-150f-4e44-b88a-573295ac9a32 with Priority: HIGHEST for action security_group_members [ 1171.678135] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 52b85252-ce7d-4ebd-99f9-296e723a90d5 with Priority: HIGHEST for action port [ 1171.678135] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-fb2958aa-150f-4e44-b88a-573295ac9a32 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.678135] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-fb2958aa-150f-4e44-b88a-573295ac9a32" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.678135] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-fb2958aa-150f-4e44-b88a-573295ac9a32" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.678338] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-fb2958aa-150f-4e44-b88a-573295ac9a32" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.678338] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('fb2958aa-150f-4e44-b88a-573295ac9a32',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.679520] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb2958aa-150f-4e44-b88a-573295ac9a32 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.679684] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb2958aa-150f-4e44-b88a-573295ac9a32" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.679740] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb2958aa-150f-4e44-b88a-573295ac9a32" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.681942] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb2958aa-150f-4e44-b88a-573295ac9a32" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.681942] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.681942] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.681942] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.681942] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.681942] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1171.681942] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb2958aa-150f-4e44-b88a-573295ac9a32',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1171.681942] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-52b85252-ce7d-4ebd-99f9-296e723a90d5 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1171.681942] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-52b85252-ce7d-4ebd-99f9-296e723a90d5" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1171.681942] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-52b85252-ce7d-4ebd-99f9-296e723a90d5" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1171.682496] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-52b85252-ce7d-4ebd-99f9-296e723a90d5" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1171.682496] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('52b85252-ce7d-4ebd-99f9-296e723a90d5',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.103585] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.103906] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.103906] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.104283] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.104441] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.104608] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 is going to be updated. [ 1172.134905] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.135070] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.135138] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.135353] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.135504] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.146018] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 in Status: IN_PROGRESS for 2s [ 1172.183910] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb2958aa-150f-4e44-b88a-573295ac9a32 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.184172] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb2958aa-150f-4e44-b88a-573295ac9a32" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.184440] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('fb2958aa-150f-4e44-b88a-573295ac9a32',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1172.185784] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 52b85252-ce7d-4ebd-99f9-296e723a90d5 with status ACTIVE [ 1172.186116] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.186310] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.186436] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.186767] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.186925] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.187193] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.187317] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.187388] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.187563] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.187646] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.187850] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.187967] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.188078] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.188243] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.188334] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.188469] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 52b85252-ce7d-4ebd-99f9-296e723a90d5 is going to be updated. [ 1172.217797] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1172.218067] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1172.218067] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1172.218341] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1172.218538] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.218758] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-52b85252-ce7d-4ebd-99f9-296e723a90d5" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.291979] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 in Status: SUCCESS [ 1172.292320] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1172.691932] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('fb2958aa-150f-4e44-b88a-573295ac9a32',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.195368] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.195983] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.195983] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.196081] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.196377] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.196466] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb2958aa-150f-4e44-b88a-573295ac9a32 is going to be created. [ 1173.223176] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.223176] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.223176] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.223176] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.223176] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.233438] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb2958aa-150f-4e44-b88a-573295ac9a32 in Status: UNINITIALIZED for 2s [ 1173.343932] env[67094]: INFO networking_nsxv3.common.synchronization [req-9d0a3b1b-0179-459c-b5bf-7a41d641f5d3 req-fb7b357f-4f0e-4326-b2c9-72801d1e2545 tempest-DeleteServersTestJSON-1237946437 tempest-DeleteServersTestJSON-1237946437-project-member] Enqueued Resource ID: 276c2084-ac8d-475a-af24-a062dc3e17aa with Priority: HIGHEST for action security_group_members [ 1173.344407] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 276c2084-ac8d-475a-af24-a062dc3e17aa with Priority: HIGHEST for action security_group_members [ 1173.344761] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-276c2084-ac8d-475a-af24-a062dc3e17aa taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.344926] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.344959] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.345154] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.345302] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.345398] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.345454] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.345597] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.345680] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.345773] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('276c2084-ac8d-475a-af24-a062dc3e17aa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.673982] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock network-318 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.674289] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "network-318" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.674439] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "network-318" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.674808] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "network-318" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.675264] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.675542] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.675749] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.676187] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.676408] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.676754] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1173.676971] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1173.677190] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1173.677412] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1173.677671] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1173.677859] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1173.678126] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1173.704682] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1173.705014] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Cache value generated in 0.027 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1173.705083] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1173.705253] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "network-318" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.705596] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock port-01678d76-032f-43ad-aeaf-4d6086a57d8a taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.705803] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "port-01678d76-032f-43ad-aeaf-4d6086a57d8a" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.705922] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "port-01678d76-032f-43ad-aeaf-4d6086a57d8a" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.706310] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "port-01678d76-032f-43ad-aeaf-4d6086a57d8a" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.706496] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01678d76-032f-43ad-aeaf-4d6086a57d8a',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1173.848555] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.848797] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.849459] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.849459] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.849459] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.851033] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.851033] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.851033] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.851033] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.851033] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.851033] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 276c2084-ac8d-475a-af24-a062dc3e17aa is going to be updated. [ 1173.877895] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1173.878067] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1173.878141] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1173.878379] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1173.878508] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1173.889742] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 276c2084-ac8d-475a-af24-a062dc3e17aa in Status: IN_PROGRESS for 2s [ 1174.157799] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 in Status: SUCCESS [ 1174.158256] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.158523] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.158906] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.159123] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.159245] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.159319] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.159462] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.159539] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.159632] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.210770] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.211168] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.211366] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.211588] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.211781] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.211953] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Segment Port 01678d76-032f-43ad-aeaf-4d6086a57d8a not found, creating... [ 1174.212252] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.212428] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.212572] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.212817] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.212940] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.213411] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.213619] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.213752] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.213967] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.214201] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.214422] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Resource: SegmentPort with ID: 01678d76-032f-43ad-aeaf-4d6086a57d8a is going to be created. [ 1174.236024] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.236024] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.236024] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.236290] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.236584] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.236704] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "port-01678d76-032f-43ad-aeaf-4d6086a57d8a" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1174.661926] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.952331] env[67094]: INFO networking_nsxv3.common.synchronization [req-9d0a3b1b-0179-459c-b5bf-7a41d641f5d3 req-4b2389eb-cff3-422d-9f81-46f52009b7f6 service nova] Enqueued Resource ID: 276c2084-ac8d-475a-af24-a062dc3e17aa with Priority: HIGHEST for action security_group_rules [ 1174.952478] env[67094]: INFO networking_nsxv3.common.synchronization [req-9d0a3b1b-0179-459c-b5bf-7a41d641f5d3 req-4b2389eb-cff3-422d-9f81-46f52009b7f6 service nova] Enqueued Resource ID: 276c2084-ac8d-475a-af24-a062dc3e17aa with Priority: HIGHEST for action security_group_members [ 1174.952625] env[67094]: INFO networking_nsxv3.common.synchronization [req-9d0a3b1b-0179-459c-b5bf-7a41d641f5d3 req-4b2389eb-cff3-422d-9f81-46f52009b7f6 service nova] Enqueued Resource ID: 01678d76-032f-43ad-aeaf-4d6086a57d8a with Priority: HIGHEST for action port [ 1174.953173] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 276c2084-ac8d-475a-af24-a062dc3e17aa with Priority: HIGHEST for action security_group_rules [ 1174.953310] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 276c2084-ac8d-475a-af24-a062dc3e17aa with Priority: HIGHEST for action security_group_members [ 1174.953404] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 01678d76-032f-43ad-aeaf-4d6086a57d8a with Priority: HIGHEST for action port [ 1174.953679] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-276c2084-ac8d-475a-af24-a062dc3e17aa taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.953821] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.953874] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.954090] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.954161] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('276c2084-ac8d-475a-af24-a062dc3e17aa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1174.955105] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-276c2084-ac8d-475a-af24-a062dc3e17aa taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.955156] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.955345] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-01678d76-032f-43ad-aeaf-4d6086a57d8a taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1174.955440] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-01678d76-032f-43ad-aeaf-4d6086a57d8a" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1174.955515] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-01678d76-032f-43ad-aeaf-4d6086a57d8a" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1174.955695] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-01678d76-032f-43ad-aeaf-4d6086a57d8a" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1174.955774] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('01678d76-032f-43ad-aeaf-4d6086a57d8a',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.164702] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.245109] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb2958aa-150f-4e44-b88a-573295ac9a32 in Status: SUCCESS [ 1175.245678] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb2958aa-150f-4e44-b88a-573295ac9a32" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.245678] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb2958aa-150f-4e44-b88a-573295ac9a32" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.245678] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb2958aa-150f-4e44-b88a-573295ac9a32" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.245820] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.245941] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.246032] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.246172] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.246252] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.246346] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb2958aa-150f-4e44-b88a-573295ac9a32" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.246422] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('fb2958aa-150f-4e44-b88a-573295ac9a32',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.457916] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-276c2084-ac8d-475a-af24-a062dc3e17aa taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.457916] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.458138] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 01678d76-032f-43ad-aeaf-4d6086a57d8a with status ACTIVE [ 1175.458230] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.459109] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.459109] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.459109] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.459109] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.459109] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.459109] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.459109] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.459880] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.459880] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.459880] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.459880] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.459880] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.459880] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.460105] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.460105] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 01678d76-032f-43ad-aeaf-4d6086a57d8a is going to be updated. [ 1175.482488] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.482680] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.482774] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.483126] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.483213] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.483415] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-01678d76-032f-43ad-aeaf-4d6086a57d8a" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.667083] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.667329] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.667329] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.668635] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.668635] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.668635] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 is going to be updated. [ 1175.710193] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.710412] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.710464] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.710769] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.710968] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.721701] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 in Status: IN_PROGRESS for 2s [ 1175.750942] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('fb2958aa-150f-4e44-b88a-573295ac9a32',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1175.903461] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 276c2084-ac8d-475a-af24-a062dc3e17aa in Status: SUCCESS [ 1175.903461] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 276c2084-ac8d-475a-af24-a062dc3e17aa deletion is rescheduled due to dependency. [ 1175.903461] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.903461] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.903461] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.903461] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1175.903461] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1175.903461] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1175.903461] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1175.903461] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1175.903461] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('276c2084-ac8d-475a-af24-a062dc3e17aa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.050210] env[67094]: INFO networking_nsxv3.common.synchronization [None req-af841240-7ee4-4213-a2c5-12d4cf913691 tempest-AttachInterfacesTestJSON-1117082489 tempest-AttachInterfacesTestJSON-1117082489-project-member] Enqueued Resource ID: 882c69d3-9554-45c6-97a1-55fb0f065040 with Priority: HIGHEST for action security_group_members [ 1176.051509] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 882c69d3-9554-45c6-97a1-55fb0f065040 with Priority: HIGHEST for action security_group_members [ 1176.052115] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-882c69d3-9554-45c6-97a1-55fb0f065040 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.052115] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.052115] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.052115] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.052115] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.052412] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.052412] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.052412] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.052506] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.052890] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('882c69d3-9554-45c6-97a1-55fb0f065040',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.253998] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for fb2958aa-150f-4e44-b88a-573295ac9a32: rpc.has_security_group_logging(os_id): False [ 1176.285919] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.285919] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.286164] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.286209] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.286300] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.286546] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.286691] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.286746] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.286868] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.286941] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.287357] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: fb2958aa-150f-4e44-b88a-573295ac9a32 is going to be created. [ 1176.379344] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.379576] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.379636] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.379836] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.380623] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.401111] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb2958aa-150f-4e44-b88a-573295ac9a32 in Status: IN_PROGRESS for 2s [ 1176.406029] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('276c2084-ac8d-475a-af24-a062dc3e17aa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1176.555282] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.555574] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.555574] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.555793] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.555902] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.556151] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.556297] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.556359] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.556557] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.556642] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.556749] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 882c69d3-9554-45c6-97a1-55fb0f065040 is going to be updated. [ 1176.596037] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1176.596278] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1176.596663] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1176.596663] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1176.596663] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1176.614499] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882c69d3-9554-45c6-97a1-55fb0f065040 in Status: IN_PROGRESS for 2s [ 1176.907638] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('276c2084-ac8d-475a-af24-a062dc3e17aa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1177.409916] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.410291] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.410291] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.410603] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.410836] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.410923] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 276c2084-ac8d-475a-af24-a062dc3e17aa is going to be updated. [ 1177.443623] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.443865] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.443865] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.444846] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.444846] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.455412] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 276c2084-ac8d-475a-af24-a062dc3e17aa in Status: IN_PROGRESS for 2s [ 1177.734885] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 in Status: SUCCESS [ 1177.735297] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.735620] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.735866] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.736880] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.736880] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.736880] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.736880] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.736880] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.737130] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.738416] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.738416] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.738519] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.738796] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.739782] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1177.740126] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1177.740443] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1177.740602] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1177.740812] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.741643] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1177.741904] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1178.245272] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6: rpc.has_security_group_logging(os_id): False [ 1178.265454] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.265745] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.265745] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.266267] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.266267] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.266411] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.266525] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.266590] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.266778] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.266864] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.267129] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.267222] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.267283] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.267428] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.267502] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.267699] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.267793] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.267851] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.267982] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.268070] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.268146] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 is going to be created. [ 1178.371134] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1178.374020] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1178.374020] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1178.374020] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1178.374020] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.390682] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 in Status: IN_PROGRESS for 2s [ 1178.414936] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: fb2958aa-150f-4e44-b88a-573295ac9a32 in Status: SUCCESS [ 1178.415293] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-fb2958aa-150f-4e44-b88a-573295ac9a32" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1178.624605] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 882c69d3-9554-45c6-97a1-55fb0f065040 in Status: SUCCESS [ 1178.624798] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 882c69d3-9554-45c6-97a1-55fb0f065040 deletion is rescheduled due to dependency. [ 1178.624895] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-882c69d3-9554-45c6-97a1-55fb0f065040" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.469568] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 276c2084-ac8d-475a-af24-a062dc3e17aa in Status: SUCCESS [ 1179.469952] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.470130] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.470388] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.470651] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.470904] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.471209] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.471209] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.471404] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.471404] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.471476] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('276c2084-ac8d-475a-af24-a062dc3e17aa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1179.973816] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-276c2084-ac8d-475a-af24-a062dc3e17aa taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.974110] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.974210] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.974428] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.974617] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.974719] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.974780] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.974960] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.975138] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.975300] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.975479] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-276c2084-ac8d-475a-af24-a062dc3e17aa taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.975611] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.975779] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.975779] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.975978] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1179.975978] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1179.976195] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1179.976323] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1179.976420] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.976507] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1179.976598] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('276c2084-ac8d-475a-af24-a062dc3e17aa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.405136] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 in Status: SUCCESS [ 1180.405419] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.405649] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.405925] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.406052] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.479801] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 276c2084-ac8d-475a-af24-a062dc3e17aa: rpc.has_security_group_logging(os_id): False [ 1180.505162] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.505368] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.505368] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.505604] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.506026] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.506026] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.506215] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.506215] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.506376] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.506450] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.506641] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.506738] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.506798] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.506937] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.507019] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.507276] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.507404] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.507404] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.507496] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.507529] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.507643] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 276c2084-ac8d-475a-af24-a062dc3e17aa is going to be updated. [ 1180.620563] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.620826] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.620960] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.621223] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.621384] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.644235] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 276c2084-ac8d-475a-af24-a062dc3e17aa in Status: IN_PROGRESS for 2s [ 1180.781707] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock network-787 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.781944] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "network-787" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.782086] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "network-787" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.782372] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "network-787" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.782633] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.782797] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.782916] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.783249] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.783418] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.783683] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1180.783799] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1180.783922] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1180.784082] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1180.784205] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1180.784312] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1180.784466] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1180.808636] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1180.808874] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1180.809058] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1180.809247] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "network-787" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.809600] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock port-9c81333c-a277-431f-aae5-2bdcc4b94edd taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.809860] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "port-9c81333c-a277-431f-aae5-2bdcc4b94edd" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.809999] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "port-9c81333c-a277-431f-aae5-2bdcc4b94edd" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.810322] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "port-9c81333c-a277-431f-aae5-2bdcc4b94edd" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.810468] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c81333c-a277-431f-aae5-2bdcc4b94edd',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1180.909089] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.909089] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.909089] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.909501] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.909557] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1180.909663] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1180.909725] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1180.909914] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1180.910017] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.910112] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1180.910212] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.053598] env[67094]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1181.053598] env[67094]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1181.314300] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.314550] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.314730] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.315028] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.315201] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.315503] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.315683] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.315848] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.316112] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.316306] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.316598] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.316755] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.316872] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.317092] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.317226] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.317387] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Resource: SegmentPort with ID: 9c81333c-a277-431f-aae5-2bdcc4b94edd is going to be updated. [ 1181.341297] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.341547] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.341648] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.342290] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.342290] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.342476] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "port-9c81333c-a277-431f-aae5-2bdcc4b94edd" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.412603] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.412806] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.412806] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.413340] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.413340] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.413340] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.413543] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.413543] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.413641] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.413692] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.413847] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.413942] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.414034] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.414148] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.414283] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.414375] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.414438] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.415040] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.415040] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.415040] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.415040] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1181.917442] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6: rpc.has_security_group_logging(os_id): False [ 1181.937178] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.937340] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.937557] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.937647] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.937684] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.937857] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.937961] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.938034] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.941040] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.941040] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.941040] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.941040] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.941040] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.941040] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.941040] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.941040] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1181.941040] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1181.941040] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1181.941040] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1181.941040] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1181.941040] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 is going to be updated. [ 1182.005473] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.005627] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.005698] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.005925] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.006326] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.023357] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 in Status: IN_PROGRESS for 2s [ 1182.036688] env[67094]: INFO networking_nsxv3.common.synchronization [req-984f71d3-999f-4044-bf54-0c3477a7d187 req-2c4a2086-7ab1-465f-a26c-25efaafcb0b6 service nova] Enqueued Resource ID: 78b18c8a-dfa7-43b1-860f-15a4c0e0a93f with Priority: HIGHEST for action security_group_rules [ 1182.036876] env[67094]: INFO networking_nsxv3.common.synchronization [req-984f71d3-999f-4044-bf54-0c3477a7d187 req-2c4a2086-7ab1-465f-a26c-25efaafcb0b6 service nova] Enqueued Resource ID: 78b18c8a-dfa7-43b1-860f-15a4c0e0a93f with Priority: HIGHEST for action security_group_members [ 1182.037028] env[67094]: INFO networking_nsxv3.common.synchronization [req-984f71d3-999f-4044-bf54-0c3477a7d187 req-2c4a2086-7ab1-465f-a26c-25efaafcb0b6 service nova] Enqueued Resource ID: 9c81333c-a277-431f-aae5-2bdcc4b94edd with Priority: HIGHEST for action port [ 1182.037613] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78b18c8a-dfa7-43b1-860f-15a4c0e0a93f with Priority: HIGHEST for action security_group_rules [ 1182.037742] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78b18c8a-dfa7-43b1-860f-15a4c0e0a93f with Priority: HIGHEST for action security_group_members [ 1182.037844] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 9c81333c-a277-431f-aae5-2bdcc4b94edd with Priority: HIGHEST for action port [ 1182.038528] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78b18c8a-dfa7-43b1-860f-15a4c0e0a93f taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.038668] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78b18c8a-dfa7-43b1-860f-15a4c0e0a93f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.038739] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78b18c8a-dfa7-43b1-860f-15a4c0e0a93f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.038982] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78b18c8a-dfa7-43b1-860f-15a4c0e0a93f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.039084] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78b18c8a-dfa7-43b1-860f-15a4c0e0a93f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.041187] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-78b18c8a-dfa7-43b1-860f-15a4c0e0a93f taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.041306] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78b18c8a-dfa7-43b1-860f-15a4c0e0a93f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.041375] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78b18c8a-dfa7-43b1-860f-15a4c0e0a93f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.041578] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78b18c8a-dfa7-43b1-860f-15a4c0e0a93f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.041765] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.041914] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.041985] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.042193] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.042286] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.042392] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78b18c8a-dfa7-43b1-860f-15a4c0e0a93f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.043695] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-9c81333c-a277-431f-aae5-2bdcc4b94edd taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.043824] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-9c81333c-a277-431f-aae5-2bdcc4b94edd" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.044087] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-9c81333c-a277-431f-aae5-2bdcc4b94edd" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.044316] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-9c81333c-a277-431f-aae5-2bdcc4b94edd" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.044442] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('9c81333c-a277-431f-aae5-2bdcc4b94edd',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.541717] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-78b18c8a-dfa7-43b1-860f-15a4c0e0a93f taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.541717] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78b18c8a-dfa7-43b1-860f-15a4c0e0a93f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.544449] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('78b18c8a-dfa7-43b1-860f-15a4c0e0a93f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1182.546064] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 9c81333c-a277-431f-aae5-2bdcc4b94edd with status ACTIVE [ 1182.546401] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.547236] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.547236] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.547236] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.547236] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.547236] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.547550] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.547550] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.547550] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.547637] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.547753] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.548237] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.548237] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.548237] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.548237] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.548237] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 9c81333c-a277-431f-aae5-2bdcc4b94edd is going to be updated. [ 1182.571566] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1182.571799] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1182.571799] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1182.572041] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1182.572192] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.572356] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-9c81333c-a277-431f-aae5-2bdcc4b94edd" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1182.664664] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 276c2084-ac8d-475a-af24-a062dc3e17aa in Status: SUCCESS [ 1182.664830] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.046683] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('78b18c8a-dfa7-43b1-860f-15a4c0e0a93f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1183.549631] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.549844] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.549923] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.550269] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.550376] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.550461] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78b18c8a-dfa7-43b1-860f-15a4c0e0a93f is going to be updated. [ 1183.591114] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1183.591365] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1183.591365] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1183.591529] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1183.591710] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1183.605734] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78b18c8a-dfa7-43b1-860f-15a4c0e0a93f in Status: IN_PROGRESS for 2s [ 1184.048835] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 in Status: SUCCESS [ 1184.048835] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.915509] env[67094]: INFO networking_nsxv3.common.synchronization [req-bb5106cd-fac2-4303-8ac0-9ccb9983c266 req-cf671dc1-be1d-4dd4-a165-26afac8739de tempest-MultipleCreateTestJSON-360930871 tempest-MultipleCreateTestJSON-360930871-project-member] Enqueued Resource ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 with Priority: HIGHEST for action security_group_members [ 1184.916028] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 with Priority: HIGHEST for action security_group_members [ 1184.916365] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.916494] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.916577] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.916790] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.916947] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1184.917077] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1184.917142] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1184.917323] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1184.917411] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1184.917746] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.419824] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.617590] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78b18c8a-dfa7-43b1-860f-15a4c0e0a93f in Status: SUCCESS [ 1185.617728] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78b18c8a-dfa7-43b1-860f-15a4c0e0a93f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.617902] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78b18c8a-dfa7-43b1-860f-15a4c0e0a93f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.618235] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78b18c8a-dfa7-43b1-860f-15a4c0e0a93f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.618396] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1185.618491] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1185.618548] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1185.618697] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1185.618777] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.618871] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78b18c8a-dfa7-43b1-860f-15a4c0e0a93f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1185.618953] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('78b18c8a-dfa7-43b1-860f-15a4c0e0a93f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1185.922403] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.121619] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('78b18c8a-dfa7-43b1-860f-15a4c0e0a93f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1186.404695] env[67094]: INFO networking_nsxv3.common.synchronization [req-861e5499-9d09-4e40-a3cd-b693e202c1f5 req-cfb27ee7-1e05-4b49-87d3-8a4bdc0e717d tempest-MultipleCreateTestJSON-360930871 tempest-MultipleCreateTestJSON-360930871-project-member] Enqueued Resource ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 with Priority: HIGHEST for action security_group_members [ 1186.405359] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 with Priority: HIGHEST for action security_group_members [ 1186.405818] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.406009] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.425032] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.425317] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.425317] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.425511] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.425571] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.425702] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 is going to be updated. [ 1186.458949] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.459685] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.459685] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.459685] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.459824] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.470850] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 in Status: IN_PROGRESS for 2s [ 1186.624570] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 78b18c8a-dfa7-43b1-860f-15a4c0e0a93f: rpc.has_security_group_logging(os_id): False [ 1186.643934] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.644133] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.644215] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.644449] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.644830] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.644937] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.645037] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.645037] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.645281] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.645420] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.645420] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78b18c8a-dfa7-43b1-860f-15a4c0e0a93f is going to be updated. [ 1186.707838] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1186.708076] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1186.708076] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1186.708388] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1186.708643] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1186.722999] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78b18c8a-dfa7-43b1-860f-15a4c0e0a93f in Status: IN_PROGRESS for 2s [ 1188.482582] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 in Status: SUCCESS [ 1188.483044] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.483338] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.483674] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.484013] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.484225] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.484347] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.484644] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.484810] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.484971] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1188.740501] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 78b18c8a-dfa7-43b1-860f-15a4c0e0a93f in Status: SUCCESS [ 1188.740501] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78b18c8a-dfa7-43b1-860f-15a4c0e0a93f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.987642] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.987642] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.987838] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.987940] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.987977] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.988311] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1188.988311] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1188.988450] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1188.988481] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1188.989574] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1188.989574] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 is going to be updated. [ 1189.020987] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.021191] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.021232] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.021495] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.021629] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.034438] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 in Status: IN_PROGRESS for 2s [ 1189.734721] env[67094]: INFO networking_nsxv3.common.synchronization [req-667ddbf8-7da4-49dc-89bb-8df698741e18 req-cc9f9f2c-ca27-4e95-9673-bfdc953ce0d6 tempest-DeleteServersTestJSON-1237946437 tempest-DeleteServersTestJSON-1237946437-project-member] Enqueued Resource ID: 276c2084-ac8d-475a-af24-a062dc3e17aa with Priority: HIGHEST for action security_group_members [ 1189.735292] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 276c2084-ac8d-475a-af24-a062dc3e17aa with Priority: HIGHEST for action security_group_members [ 1189.735540] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-276c2084-ac8d-475a-af24-a062dc3e17aa taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.735681] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.736171] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.736171] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.736171] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.736462] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.736462] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.736462] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.736549] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.736577] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('276c2084-ac8d-475a-af24-a062dc3e17aa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1189.991733] env[67094]: INFO networking_nsxv3.common.synchronization [req-cd8c2496-85d6-453d-b545-3928ffce2bcd req-a9cc0e64-4c30-48b3-a46b-0886cc768080 tempest-ServerActionsTestOtherA-276518123 tempest-ServerActionsTestOtherA-276518123-project-member] Enqueued Resource ID: 005d1062-21f3-48fc-b7a0-06c9f0fc7843 with Priority: HIGHEST for action security_group_members [ 1189.992382] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 005d1062-21f3-48fc-b7a0-06c9f0fc7843 with Priority: HIGHEST for action security_group_members [ 1189.993164] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-005d1062-21f3-48fc-b7a0-06c9f0fc7843 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.993303] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-005d1062-21f3-48fc-b7a0-06c9f0fc7843" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.993367] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-005d1062-21f3-48fc-b7a0-06c9f0fc7843" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.993591] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-005d1062-21f3-48fc-b7a0-06c9f0fc7843" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.993751] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1189.993852] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1189.993918] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1189.994085] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1189.994172] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1189.994265] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('005d1062-21f3-48fc-b7a0-06c9f0fc7843',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.239309] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.239529] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.239599] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.239827] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.239903] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.240456] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.240456] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.240456] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.240758] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.240758] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.240758] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 276c2084-ac8d-475a-af24-a062dc3e17aa is going to be updated. [ 1190.271371] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.271650] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.271650] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.271764] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.271944] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.282828] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 276c2084-ac8d-475a-af24-a062dc3e17aa in Status: IN_PROGRESS for 2s [ 1190.464781] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock network-997 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.465031] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "network-997" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.465164] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "network-997" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.465440] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "network-997" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.465730] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.465907] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.466039] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.466287] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.466430] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.466652] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1190.466776] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1190.466891] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1190.467040] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1190.467183] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1190.467301] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1190.467452] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1190.492510] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1190.492813] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Cache value generated in 0.025 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1190.492908] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1190.493135] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "network-997" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.493449] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock port-fd936da1-ec3d-4d62-88b0-e414edf2e3df taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.493630] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "port-fd936da1-ec3d-4d62-88b0-e414edf2e3df" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.493750] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "port-fd936da1-ec3d-4d62-88b0-e414edf2e3df" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.494121] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "port-fd936da1-ec3d-4d62-88b0-e414edf2e3df" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.494268] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd936da1-ec3d-4d62-88b0-e414edf2e3df',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.495957] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('005d1062-21f3-48fc-b7a0-06c9f0fc7843',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1190.998480] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.998480] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.998480] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.998480] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.998480] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.998480] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Segment Port fd936da1-ec3d-4d62-88b0-e414edf2e3df not found, creating... [ 1190.998480] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1190.998480] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1190.998480] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1190.999116] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1190.999116] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1190.999773] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.000069] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.000229] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.000463] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.000663] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.000884] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Resource: SegmentPort with ID: fd936da1-ec3d-4d62-88b0-e414edf2e3df is going to be created. [ 1191.001989] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('005d1062-21f3-48fc-b7a0-06c9f0fc7843',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.026352] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.026573] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.026699] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.026993] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.027249] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.027613] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "port-fd936da1-ec3d-4d62-88b0-e414edf2e3df" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.057625] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 in Status: SUCCESS [ 1191.057900] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 deletion is rescheduled due to dependency. [ 1191.058088] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.505413] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.505666] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.505666] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.506604] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.506604] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.506604] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 005d1062-21f3-48fc-b7a0-06c9f0fc7843 is going to be updated. [ 1191.540050] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.540223] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.540278] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.540508] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.540660] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1191.555640] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 005d1062-21f3-48fc-b7a0-06c9f0fc7843 in Status: IN_PROGRESS for 2s [ 1191.758788] env[67094]: INFO networking_nsxv3.common.synchronization [req-cd8c2496-85d6-453d-b545-3928ffce2bcd req-4951fb5e-ba79-4ecc-b0a6-4d78b498496a service nova] Enqueued Resource ID: 005d1062-21f3-48fc-b7a0-06c9f0fc7843 with Priority: HIGHEST for action security_group_rules [ 1191.758788] env[67094]: INFO networking_nsxv3.common.synchronization [req-cd8c2496-85d6-453d-b545-3928ffce2bcd req-4951fb5e-ba79-4ecc-b0a6-4d78b498496a service nova] Enqueued Resource ID: 005d1062-21f3-48fc-b7a0-06c9f0fc7843 with Priority: HIGHEST for action security_group_members [ 1191.758788] env[67094]: INFO networking_nsxv3.common.synchronization [req-cd8c2496-85d6-453d-b545-3928ffce2bcd req-4951fb5e-ba79-4ecc-b0a6-4d78b498496a service nova] Enqueued Resource ID: fd936da1-ec3d-4d62-88b0-e414edf2e3df with Priority: HIGHEST for action port [ 1191.758788] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 005d1062-21f3-48fc-b7a0-06c9f0fc7843 with Priority: HIGHEST for action security_group_rules [ 1191.758788] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 005d1062-21f3-48fc-b7a0-06c9f0fc7843 with Priority: HIGHEST for action security_group_members [ 1191.758788] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fd936da1-ec3d-4d62-88b0-e414edf2e3df with Priority: HIGHEST for action port [ 1191.759488] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-005d1062-21f3-48fc-b7a0-06c9f0fc7843 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.759819] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-005d1062-21f3-48fc-b7a0-06c9f0fc7843" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.760035] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-005d1062-21f3-48fc-b7a0-06c9f0fc7843" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.761050] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-005d1062-21f3-48fc-b7a0-06c9f0fc7843" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.761050] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('005d1062-21f3-48fc-b7a0-06c9f0fc7843',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1191.761769] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-005d1062-21f3-48fc-b7a0-06c9f0fc7843 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.762766] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-005d1062-21f3-48fc-b7a0-06c9f0fc7843" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.763089] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-fd936da1-ec3d-4d62-88b0-e414edf2e3df taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1191.763280] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-fd936da1-ec3d-4d62-88b0-e414edf2e3df" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1191.763419] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-fd936da1-ec3d-4d62-88b0-e414edf2e3df" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1191.763655] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-fd936da1-ec3d-4d62-88b0-e414edf2e3df" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1191.764086] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('fd936da1-ec3d-4d62-88b0-e414edf2e3df',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1192.266178] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-005d1062-21f3-48fc-b7a0-06c9f0fc7843 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.266679] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-005d1062-21f3-48fc-b7a0-06c9f0fc7843" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.266679] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port fd936da1-ec3d-4d62-88b0-e414edf2e3df with status ACTIVE [ 1192.266760] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.266884] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.266989] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.267494] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.267637] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.267945] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.268131] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.268234] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.268479] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.268652] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.268891] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.269053] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.269053] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.269235] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.269276] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.269362] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: fd936da1-ec3d-4d62-88b0-e414edf2e3df is going to be updated. [ 1192.298442] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 276c2084-ac8d-475a-af24-a062dc3e17aa in Status: SUCCESS [ 1192.298836] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 276c2084-ac8d-475a-af24-a062dc3e17aa deletion is rescheduled due to dependency. [ 1192.298937] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.310184] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1192.310462] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1192.310462] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1192.310619] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1192.310807] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1192.311032] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-fd936da1-ec3d-4d62-88b0-e414edf2e3df" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.566681] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 005d1062-21f3-48fc-b7a0-06c9f0fc7843 in Status: SUCCESS [ 1193.567023] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-005d1062-21f3-48fc-b7a0-06c9f0fc7843" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.567023] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-005d1062-21f3-48fc-b7a0-06c9f0fc7843" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.567242] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-005d1062-21f3-48fc-b7a0-06c9f0fc7843" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.567363] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1193.567496] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1193.567582] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1193.567754] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1193.567840] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1193.567936] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('005d1062-21f3-48fc-b7a0-06c9f0fc7843',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.070358] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('005d1062-21f3-48fc-b7a0-06c9f0fc7843',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1194.574072] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('005d1062-21f3-48fc-b7a0-06c9f0fc7843',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1195.075820] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.076244] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.076244] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.076345] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.076385] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.076543] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 005d1062-21f3-48fc-b7a0-06c9f0fc7843 is going to be updated. [ 1195.114946] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1195.115124] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1195.115169] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1195.116060] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1195.116060] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1195.126654] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 005d1062-21f3-48fc-b7a0-06c9f0fc7843 in Status: IN_PROGRESS for 2s [ 1196.759061] env[67094]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1196.759398] env[67094]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=2 [ 1197.139541] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 005d1062-21f3-48fc-b7a0-06c9f0fc7843 in Status: SUCCESS [ 1197.142019] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-005d1062-21f3-48fc-b7a0-06c9f0fc7843" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.142019] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-005d1062-21f3-48fc-b7a0-06c9f0fc7843" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.142019] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-005d1062-21f3-48fc-b7a0-06c9f0fc7843" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.142019] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.142019] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.142019] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.142019] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.142019] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.142019] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-005d1062-21f3-48fc-b7a0-06c9f0fc7843" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.142019] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('005d1062-21f3-48fc-b7a0-06c9f0fc7843',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.183215] env[67094]: INFO networking_nsxv3.common.synchronization [req-3ad64958-3195-4aa7-aa8d-d87ecc662524 req-735b959c-f08c-48d6-83e0-82623ed62a13 tempest-ServerActionsTestOtherB-1168296312 tempest-ServerActionsTestOtherB-1168296312-project-member] Enqueued Resource ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 with Priority: HIGHEST for action security_group_members [ 1197.183807] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 with Priority: HIGHEST for action security_group_members [ 1197.184659] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.184659] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.184659] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.184659] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.184659] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.185038] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.185038] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.185038] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.185038] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.185174] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.644586] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('005d1062-21f3-48fc-b7a0-06c9f0fc7843',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1197.687689] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.687898] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.687981] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.688265] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.688374] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.688622] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.688736] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.688818] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.688978] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.689069] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.689156] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 is going to be updated. [ 1197.717673] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1197.717856] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1197.717902] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1197.718102] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1197.718248] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1197.727070] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 in Status: IN_PROGRESS for 2s [ 1198.146630] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 005d1062-21f3-48fc-b7a0-06c9f0fc7843: rpc.has_security_group_logging(os_id): False [ 1198.166038] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.166811] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.166811] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.166987] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.186784] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.187091] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.187247] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.187341] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.187591] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.187680] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.187773] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 005d1062-21f3-48fc-b7a0-06c9f0fc7843 is going to be updated. [ 1198.251714] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1198.251973] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1198.251973] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1198.252190] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1198.252336] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1198.263601] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 005d1062-21f3-48fc-b7a0-06c9f0fc7843 in Status: IN_PROGRESS for 2s [ 1199.737420] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 in Status: SUCCESS [ 1199.737420] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 deletion is rescheduled due to dependency. [ 1199.737420] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1200.276503] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 005d1062-21f3-48fc-b7a0-06c9f0fc7843 in Status: SUCCESS [ 1200.276639] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-005d1062-21f3-48fc-b7a0-06c9f0fc7843" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.185241] env[67094]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1202.185617] env[67094]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1202.902246] env[67094]: INFO networking_nsxv3.common.synchronization [req-2c0f1d04-3755-4010-b80b-5b1cbcfa5d6e req-3fe1707e-adb7-453e-b137-02783b67c72d tempest-DeleteServersTestJSON-1237946437 tempest-DeleteServersTestJSON-1237946437-project-member] Enqueued Resource ID: 276c2084-ac8d-475a-af24-a062dc3e17aa with Priority: HIGHEST for action security_group_members [ 1202.902779] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 276c2084-ac8d-475a-af24-a062dc3e17aa with Priority: HIGHEST for action security_group_members [ 1202.903153] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-276c2084-ac8d-475a-af24-a062dc3e17aa taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.903279] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.903346] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.903539] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.903692] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1202.903822] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1202.903877] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1202.903994] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1202.904093] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1202.904187] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('276c2084-ac8d-475a-af24-a062dc3e17aa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.208696] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock network-318 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.208970] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "network-318" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.209075] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "network-318" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.209392] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "network-318" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.209654] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.209807] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.209923] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.210154] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.210296] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.210498] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1203.210609] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1203.210717] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1203.210824] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1203.210989] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1203.211121] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1203.211484] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1203.231211] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1203.231375] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1203.231585] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1203.231801] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "network-318" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.232157] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock port-3ea968cd-aaa9-4349-82b0-aed1e8a0ba3d taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.232364] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "port-3ea968cd-aaa9-4349-82b0-aed1e8a0ba3d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.232567] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "port-3ea968cd-aaa9-4349-82b0-aed1e8a0ba3d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.232908] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "port-3ea968cd-aaa9-4349-82b0-aed1e8a0ba3d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.233088] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ea968cd-aaa9-4349-82b0-aed1e8a0ba3d',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1203.407156] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.407374] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.407374] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.407582] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.407674] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.407881] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.407980] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.408061] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.408208] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.408286] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.408373] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 276c2084-ac8d-475a-af24-a062dc3e17aa is going to be updated. [ 1203.433574] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.433787] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.433787] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.433987] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.434224] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.443396] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 276c2084-ac8d-475a-af24-a062dc3e17aa in Status: IN_PROGRESS for 2s [ 1203.735209] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.735460] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.735640] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.735848] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.735995] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.736165] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Segment Port 3ea968cd-aaa9-4349-82b0-aed1e8a0ba3d not found, creating... [ 1203.736427] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.736585] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.736701] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.736927] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.737066] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.737627] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.737627] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.737627] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.738780] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.738780] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.738780] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Resource: SegmentPort with ID: 3ea968cd-aaa9-4349-82b0-aed1e8a0ba3d is going to be created. [ 1203.759828] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1203.760120] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1203.760279] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1203.760559] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1203.760784] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1203.761039] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "port-3ea968cd-aaa9-4349-82b0-aed1e8a0ba3d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.460109] env[67094]: INFO networking_nsxv3.common.synchronization [req-2c0f1d04-3755-4010-b80b-5b1cbcfa5d6e req-2f78c6f6-73b2-4c19-b56f-850a8ae51f47 service nova] Enqueued Resource ID: 276c2084-ac8d-475a-af24-a062dc3e17aa with Priority: HIGHEST for action security_group_rules [ 1204.460354] env[67094]: INFO networking_nsxv3.common.synchronization [req-2c0f1d04-3755-4010-b80b-5b1cbcfa5d6e req-2f78c6f6-73b2-4c19-b56f-850a8ae51f47 service nova] Enqueued Resource ID: 276c2084-ac8d-475a-af24-a062dc3e17aa with Priority: HIGHEST for action security_group_members [ 1204.460445] env[67094]: INFO networking_nsxv3.common.synchronization [req-2c0f1d04-3755-4010-b80b-5b1cbcfa5d6e req-2f78c6f6-73b2-4c19-b56f-850a8ae51f47 service nova] Enqueued Resource ID: 3ea968cd-aaa9-4349-82b0-aed1e8a0ba3d with Priority: HIGHEST for action port [ 1204.463482] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 276c2084-ac8d-475a-af24-a062dc3e17aa with Priority: HIGHEST for action security_group_rules [ 1204.463482] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 276c2084-ac8d-475a-af24-a062dc3e17aa with Priority: HIGHEST for action security_group_members [ 1204.463482] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3ea968cd-aaa9-4349-82b0-aed1e8a0ba3d with Priority: HIGHEST for action port [ 1204.463482] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-276c2084-ac8d-475a-af24-a062dc3e17aa taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.463482] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.463482] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.463482] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.463482] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('276c2084-ac8d-475a-af24-a062dc3e17aa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.464043] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-276c2084-ac8d-475a-af24-a062dc3e17aa taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.464043] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.464137] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-3ea968cd-aaa9-4349-82b0-aed1e8a0ba3d taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.464216] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-3ea968cd-aaa9-4349-82b0-aed1e8a0ba3d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.464285] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-3ea968cd-aaa9-4349-82b0-aed1e8a0ba3d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.464451] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-3ea968cd-aaa9-4349-82b0-aed1e8a0ba3d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.464530] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('3ea968cd-aaa9-4349-82b0-aed1e8a0ba3d',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1204.965791] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-276c2084-ac8d-475a-af24-a062dc3e17aa taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.966741] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.969368] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 3ea968cd-aaa9-4349-82b0-aed1e8a0ba3d with status ACTIVE [ 1204.969560] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.969680] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.969744] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.969951] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.970047] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.970224] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.970321] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.970379] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.970534] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.970605] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.970777] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.970862] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.970925] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.971102] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.971173] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.971563] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 3ea968cd-aaa9-4349-82b0-aed1e8a0ba3d is going to be updated. [ 1204.997508] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1204.997716] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1204.997801] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1204.998011] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1204.998179] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1204.998385] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-3ea968cd-aaa9-4349-82b0-aed1e8a0ba3d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.454322] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 276c2084-ac8d-475a-af24-a062dc3e17aa in Status: SUCCESS [ 1205.454583] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 276c2084-ac8d-475a-af24-a062dc3e17aa deletion is rescheduled due to dependency. [ 1205.454657] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.454770] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.455040] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.455243] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1205.455363] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1205.455428] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1205.455589] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1205.455670] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1205.455769] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('276c2084-ac8d-475a-af24-a062dc3e17aa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1205.958601] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('276c2084-ac8d-475a-af24-a062dc3e17aa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.460111] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('276c2084-ac8d-475a-af24-a062dc3e17aa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1206.965276] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1206.965276] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1206.965276] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1206.965276] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1206.965276] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1206.965276] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 276c2084-ac8d-475a-af24-a062dc3e17aa is going to be updated. [ 1207.011698] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1207.011698] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1207.011698] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1207.012060] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1207.012147] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1207.021178] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 276c2084-ac8d-475a-af24-a062dc3e17aa in Status: IN_PROGRESS for 2s [ 1209.032548] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 276c2084-ac8d-475a-af24-a062dc3e17aa in Status: SUCCESS [ 1209.032907] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.032907] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.033146] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.033367] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.033485] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.033551] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.033710] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.033791] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.033878] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.033973] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('276c2084-ac8d-475a-af24-a062dc3e17aa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.368160] env[67094]: INFO networking_nsxv3.common.synchronization [req-104d3e8c-335b-4fdd-a76e-664c809f4486 req-8bbaf8c8-bde4-4ad2-9ffe-0e4f78f9f5ed tempest-ServerActionsTestOtherB-1168296312 tempest-ServerActionsTestOtherB-1168296312-project-member] Enqueued Resource ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 with Priority: HIGHEST for action security_group_members [ 1209.368545] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 with Priority: HIGHEST for action security_group_members [ 1209.368873] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.369017] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.369519] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.369519] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.369662] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.369662] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.369742] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.369966] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.371690] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.371690] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.535855] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-276c2084-ac8d-475a-af24-a062dc3e17aa taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.536077] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.536142] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.536370] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.537014] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.537157] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.537223] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.537457] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.537554] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.538114] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.538343] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-276c2084-ac8d-475a-af24-a062dc3e17aa taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.538484] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.538577] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.538755] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.538971] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.539098] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.539182] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.539333] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.539434] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.539522] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.539611] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('276c2084-ac8d-475a-af24-a062dc3e17aa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.631885] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock network-78 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.632188] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "network-78" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.632702] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "network-78" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.633069] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "network-78" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.633381] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.633548] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.633666] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.633907] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.634066] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.634279] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1209.634394] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1209.634505] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1209.634617] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1209.634728] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1209.634837] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1209.634969] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1209.657581] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1209.657819] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1209.657898] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1209.658095] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "network-78" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.658417] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock port-16bd0d62-83f4-4f8a-998a-5a4e4accb222 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.658605] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "port-16bd0d62-83f4-4f8a-998a-5a4e4accb222" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.658725] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "port-16bd0d62-83f4-4f8a-998a-5a4e4accb222" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.659122] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "port-16bd0d62-83f4-4f8a-998a-5a4e4accb222" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.659265] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16bd0d62-83f4-4f8a-998a-5a4e4accb222',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1209.873082] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.873082] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.873082] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.873388] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.873426] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.873608] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.873707] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.873769] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.873912] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.873989] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.874089] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 is going to be updated. [ 1209.903531] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1209.903736] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1209.903736] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1209.903866] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1209.904024] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1209.918696] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 in Status: IN_PROGRESS for 2s [ 1210.042089] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 276c2084-ac8d-475a-af24-a062dc3e17aa: rpc.has_security_group_logging(os_id): False [ 1210.062043] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.062243] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.062243] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.062628] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.062628] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.062879] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.062988] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.063111] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.063381] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.063381] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.063641] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.063779] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.063829] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.064034] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.064139] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.064301] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.064444] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.064518] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.064607] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.064703] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.064759] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 276c2084-ac8d-475a-af24-a062dc3e17aa is going to be updated. [ 1210.131017] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.131264] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.131264] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.131464] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.131579] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.147359] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 276c2084-ac8d-475a-af24-a062dc3e17aa in Status: IN_PROGRESS for 2s [ 1210.161530] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.161698] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.161804] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.162168] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.162349] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.162560] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Segment Port 16bd0d62-83f4-4f8a-998a-5a4e4accb222 not found, creating... [ 1210.162827] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.162988] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.163136] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.163356] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.163494] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.163792] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.163938] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.164048] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.164337] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.164483] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.164653] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Resource: SegmentPort with ID: 16bd0d62-83f4-4f8a-998a-5a4e4accb222 is going to be created. [ 1210.184029] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.184229] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.184357] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.184602] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.184843] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.185072] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "port-16bd0d62-83f4-4f8a-998a-5a4e4accb222" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1210.889844] env[67094]: INFO networking_nsxv3.common.synchronization [req-104d3e8c-335b-4fdd-a76e-664c809f4486 req-dc311237-c7b4-42cf-ad38-17c0fd37a03b service nova] Enqueued Resource ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 with Priority: HIGHEST for action security_group_rules [ 1210.889986] env[67094]: INFO networking_nsxv3.common.synchronization [req-104d3e8c-335b-4fdd-a76e-664c809f4486 req-dc311237-c7b4-42cf-ad38-17c0fd37a03b service nova] Enqueued Resource ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 with Priority: HIGHEST for action security_group_members [ 1210.890073] env[67094]: INFO networking_nsxv3.common.synchronization [req-104d3e8c-335b-4fdd-a76e-664c809f4486 req-dc311237-c7b4-42cf-ad38-17c0fd37a03b service nova] Enqueued Resource ID: 16bd0d62-83f4-4f8a-998a-5a4e4accb222 with Priority: HIGHEST for action port [ 1210.890632] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 with Priority: HIGHEST for action security_group_rules [ 1210.890769] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 with Priority: HIGHEST for action security_group_members [ 1210.890869] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16bd0d62-83f4-4f8a-998a-5a4e4accb222 with Priority: HIGHEST for action port [ 1210.891456] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.891516] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.891586] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.891795] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.891884] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1210.893349] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.893445] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.893994] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-16bd0d62-83f4-4f8a-998a-5a4e4accb222 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1210.893994] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-16bd0d62-83f4-4f8a-998a-5a4e4accb222" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1210.893994] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-16bd0d62-83f4-4f8a-998a-5a4e4accb222" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1210.894175] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-16bd0d62-83f4-4f8a-998a-5a4e4accb222" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1210.894554] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16bd0d62-83f4-4f8a-998a-5a4e4accb222',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1211.393982] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.394390] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.396499] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 16bd0d62-83f4-4f8a-998a-5a4e4accb222 with status ACTIVE [ 1211.396682] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.396801] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.396943] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.397161] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.397202] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.397348] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.397433] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.397501] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.397660] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.397738] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.397916] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.398011] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.398066] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.398204] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.398285] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.398369] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 16bd0d62-83f4-4f8a-998a-5a4e4accb222 is going to be updated. [ 1211.419646] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.419851] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.419851] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.420061] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.420204] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.420360] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-16bd0d62-83f4-4f8a-998a-5a4e4accb222" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.930737] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 in Status: SUCCESS [ 1211.931019] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 deletion is rescheduled due to dependency. [ 1211.931255] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.931412] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.931649] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.931865] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1211.932037] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1211.932113] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1211.932297] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1211.932405] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1211.932567] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.165290] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 276c2084-ac8d-475a-af24-a062dc3e17aa in Status: SUCCESS [ 1212.165508] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1212.434795] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1212.937764] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1213.440681] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.441352] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.441352] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.441352] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.441352] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.441352] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 is going to be updated. [ 1213.474449] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1213.474640] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1213.474706] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1213.474948] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1213.475142] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1213.486439] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 in Status: IN_PROGRESS for 2s [ 1215.506893] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 in Status: SUCCESS [ 1215.507351] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.507523] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.507883] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.508313] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1215.508480] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1215.508585] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1215.508867] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1215.508965] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.509181] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1215.509326] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1215.892444] env[67094]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1215.892644] env[67094]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1216.012469] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.510291] env[67094]: INFO networking_nsxv3.common.synchronization [req-ec72386a-7251-45c6-a187-f449eba3fe0a req-58e221e3-dbdf-422a-ba3c-e585140e425c tempest-DeleteServersTestJSON-1237946437 tempest-DeleteServersTestJSON-1237946437-project-member] Enqueued Resource ID: 276c2084-ac8d-475a-af24-a062dc3e17aa with Priority: HIGHEST for action security_group_members [ 1216.510291] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 276c2084-ac8d-475a-af24-a062dc3e17aa with Priority: HIGHEST for action security_group_members [ 1216.510749] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-276c2084-ac8d-475a-af24-a062dc3e17aa taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.510749] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.510749] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.510878] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.511095] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.511240] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.511323] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.511631] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.511631] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.511747] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('276c2084-ac8d-475a-af24-a062dc3e17aa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1216.515026] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9: rpc.has_security_group_logging(os_id): False [ 1216.536666] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.536830] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.536890] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.537174] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.537246] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.537498] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.537639] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.537680] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.538725] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.538725] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.538725] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 is going to be updated. [ 1216.603503] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1216.603727] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1216.603802] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1216.604122] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1216.604291] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1216.620279] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 in Status: IN_PROGRESS for 2s [ 1217.013725] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.013927] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.013974] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.014197] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.014296] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.014499] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.014604] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.014668] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.014821] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.014913] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.015020] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 276c2084-ac8d-475a-af24-a062dc3e17aa is going to be updated. [ 1217.044674] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1217.044870] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1217.044870] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1217.045111] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1217.045255] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1217.057340] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 276c2084-ac8d-475a-af24-a062dc3e17aa in Status: IN_PROGRESS for 2s [ 1218.635690] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 in Status: SUCCESS [ 1218.636028] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1219.067712] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 276c2084-ac8d-475a-af24-a062dc3e17aa in Status: SUCCESS [ 1219.067956] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 276c2084-ac8d-475a-af24-a062dc3e17aa deletion is rescheduled due to dependency. [ 1219.068104] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.955227] env[67094]: INFO networking_nsxv3.common.synchronization [req-2d2caed7-9b99-4548-a0ac-c020feb8fab2 req-cfb3da55-8aef-41b7-980f-d4ce1f3bf2a9 tempest-AttachVolumeNegativeTest-737516548 tempest-AttachVolumeNegativeTest-737516548-project-member] Enqueued Resource ID: fb2958aa-150f-4e44-b88a-573295ac9a32 with Priority: HIGHEST for action security_group_members [ 1220.956284] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: fb2958aa-150f-4e44-b88a-573295ac9a32 with Priority: HIGHEST for action security_group_members [ 1220.956284] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-fb2958aa-150f-4e44-b88a-573295ac9a32 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.956284] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-fb2958aa-150f-4e44-b88a-573295ac9a32" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.957090] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-fb2958aa-150f-4e44-b88a-573295ac9a32" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.957090] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-fb2958aa-150f-4e44-b88a-573295ac9a32" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.957090] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1220.957090] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1220.957090] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1220.957090] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1220.957090] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1220.957319] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('fb2958aa-150f-4e44-b88a-573295ac9a32',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1221.460628] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.460809] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.460867] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.461203] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.461351] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.461576] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.461688] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.461753] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.461979] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.462129] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.462227] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb2958aa-150f-4e44-b88a-573295ac9a32 is going to be updated. [ 1221.491909] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1221.491909] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1221.491909] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1221.492311] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1221.492311] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1221.500720] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb2958aa-150f-4e44-b88a-573295ac9a32 in Status: IN_PROGRESS for 2s [ 1223.511738] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: fb2958aa-150f-4e44-b88a-573295ac9a32 in Status: SUCCESS [ 1223.512192] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: fb2958aa-150f-4e44-b88a-573295ac9a32 deletion is rescheduled due to dependency. [ 1223.512192] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-fb2958aa-150f-4e44-b88a-573295ac9a32" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.242285] env[67094]: INFO networking_nsxv3.common.synchronization [req-f7c01598-47af-4eb0-843e-01e6c6c62931 req-239491dd-48b8-4210-96a8-ca801748f0b7 tempest-DeleteServersTestJSON-1237946437 tempest-DeleteServersTestJSON-1237946437-project-member] Enqueued Resource ID: 276c2084-ac8d-475a-af24-a062dc3e17aa with Priority: HIGHEST for action security_group_members [ 1225.243559] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 276c2084-ac8d-475a-af24-a062dc3e17aa with Priority: HIGHEST for action security_group_members [ 1225.243559] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-276c2084-ac8d-475a-af24-a062dc3e17aa taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.243559] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.243559] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.243796] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.243796] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.244488] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.244488] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.244488] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.244488] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.244488] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('276c2084-ac8d-475a-af24-a062dc3e17aa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.560634] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock network-318 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.560846] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "network-318" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.560971] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "network-318" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.561307] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "network-318" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.561563] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.561725] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.561833] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.562055] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.562246] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.562458] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1225.562571] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1225.562680] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1225.562850] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1225.562972] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1225.563088] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1225.563246] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1225.582925] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1225.583115] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1225.583253] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1225.583421] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "network-318" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.583724] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock port-de365360-6037-476f-bb24-57ce72a65b1f taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.583894] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "port-de365360-6037-476f-bb24-57ce72a65b1f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.584024] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "port-de365360-6037-476f-bb24-57ce72a65b1f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.584348] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "port-de365360-6037-476f-bb24-57ce72a65b1f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.584490] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de365360-6037-476f-bb24-57ce72a65b1f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1225.746764] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.747082] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.747082] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.747217] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.747289] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.747495] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.747599] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.747673] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.747846] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.747926] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.748028] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 276c2084-ac8d-475a-af24-a062dc3e17aa is going to be updated. [ 1225.775030] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1225.775264] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1225.775328] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1225.775504] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1225.775654] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1225.785753] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 276c2084-ac8d-475a-af24-a062dc3e17aa in Status: IN_PROGRESS for 2s [ 1226.087589] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.087806] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.087806] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.088171] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.088402] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.088606] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Segment Port de365360-6037-476f-bb24-57ce72a65b1f not found, creating... [ 1226.088833] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.088992] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.089133] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.089368] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.089505] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.090023] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.090023] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.090149] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.090284] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.090432] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.090572] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Resource: SegmentPort with ID: de365360-6037-476f-bb24-57ce72a65b1f is going to be created. [ 1226.112413] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.112664] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.112809] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.113149] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.113449] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.113698] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "port-de365360-6037-476f-bb24-57ce72a65b1f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1226.812190] env[67094]: INFO networking_nsxv3.common.synchronization [req-f7c01598-47af-4eb0-843e-01e6c6c62931 req-6d90b4a4-239e-4111-8d03-a9f14cb143f4 service nova] Enqueued Resource ID: 276c2084-ac8d-475a-af24-a062dc3e17aa with Priority: HIGHEST for action security_group_rules [ 1226.812190] env[67094]: INFO networking_nsxv3.common.synchronization [req-f7c01598-47af-4eb0-843e-01e6c6c62931 req-6d90b4a4-239e-4111-8d03-a9f14cb143f4 service nova] Enqueued Resource ID: 276c2084-ac8d-475a-af24-a062dc3e17aa with Priority: HIGHEST for action security_group_members [ 1226.812190] env[67094]: INFO networking_nsxv3.common.synchronization [req-f7c01598-47af-4eb0-843e-01e6c6c62931 req-6d90b4a4-239e-4111-8d03-a9f14cb143f4 service nova] Enqueued Resource ID: de365360-6037-476f-bb24-57ce72a65b1f with Priority: HIGHEST for action port [ 1226.812620] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 276c2084-ac8d-475a-af24-a062dc3e17aa with Priority: HIGHEST for action security_group_rules [ 1226.812925] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 276c2084-ac8d-475a-af24-a062dc3e17aa with Priority: HIGHEST for action security_group_members [ 1226.813224] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: de365360-6037-476f-bb24-57ce72a65b1f with Priority: HIGHEST for action port [ 1226.813591] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-276c2084-ac8d-475a-af24-a062dc3e17aa taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.813832] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.813988] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.814271] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.814535] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('276c2084-ac8d-475a-af24-a062dc3e17aa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1226.815443] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-276c2084-ac8d-475a-af24-a062dc3e17aa taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.815744] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.816039] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-de365360-6037-476f-bb24-57ce72a65b1f taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1226.816263] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-de365360-6037-476f-bb24-57ce72a65b1f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1226.816435] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-de365360-6037-476f-bb24-57ce72a65b1f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1226.816704] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-de365360-6037-476f-bb24-57ce72a65b1f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1226.816872] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('de365360-6037-476f-bb24-57ce72a65b1f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1227.318971] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-276c2084-ac8d-475a-af24-a062dc3e17aa taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.319145] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.319379] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port de365360-6037-476f-bb24-57ce72a65b1f with status ACTIVE [ 1227.319632] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.319702] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.319872] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.319967] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.320072] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.320249] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.320347] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.320408] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.320566] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.320644] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.320819] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.320913] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.320979] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.321175] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.321262] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.321349] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: de365360-6037-476f-bb24-57ce72a65b1f is going to be updated. [ 1227.345517] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.345671] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.345742] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.345945] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.347023] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.347023] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-de365360-6037-476f-bb24-57ce72a65b1f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.795568] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 276c2084-ac8d-475a-af24-a062dc3e17aa in Status: SUCCESS [ 1227.795883] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 276c2084-ac8d-475a-af24-a062dc3e17aa deletion is rescheduled due to dependency. [ 1227.795974] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.796201] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.796383] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.796580] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1227.796699] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1227.796764] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1227.796943] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1227.797012] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1227.797111] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('276c2084-ac8d-475a-af24-a062dc3e17aa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.298979] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('276c2084-ac8d-475a-af24-a062dc3e17aa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1228.801774] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('276c2084-ac8d-475a-af24-a062dc3e17aa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1229.303352] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.303716] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.303716] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.303841] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.303932] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.304037] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 276c2084-ac8d-475a-af24-a062dc3e17aa is going to be updated. [ 1229.332414] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1229.332647] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1229.332647] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1229.332842] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1229.332997] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1229.344026] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 276c2084-ac8d-475a-af24-a062dc3e17aa in Status: IN_PROGRESS for 2s [ 1231.355041] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 276c2084-ac8d-475a-af24-a062dc3e17aa in Status: SUCCESS [ 1231.355375] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.355429] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.355636] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.355831] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.355937] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.356014] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.356161] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.356240] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.356322] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.356571] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('276c2084-ac8d-475a-af24-a062dc3e17aa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1231.813961] env[67094]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1231.814179] env[67094]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1231.858809] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-276c2084-ac8d-475a-af24-a062dc3e17aa taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.859065] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.859144] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.859414] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.859616] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.859725] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.859822] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.859986] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.860112] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.860202] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.860347] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-276c2084-ac8d-475a-af24-a062dc3e17aa taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.860458] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.860508] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.860677] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.860813] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1231.860926] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1231.860988] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1231.861196] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1231.861307] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.861351] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1231.861447] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('276c2084-ac8d-475a-af24-a062dc3e17aa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1232.364462] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 276c2084-ac8d-475a-af24-a062dc3e17aa: rpc.has_security_group_logging(os_id): False [ 1232.383846] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.384021] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.384066] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.384297] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.384390] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.384606] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.384731] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.384788] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.384920] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.384997] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.385189] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.385293] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.385394] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.385490] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.385562] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.385739] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.385826] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.385881] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.386028] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.386105] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.386188] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 276c2084-ac8d-475a-af24-a062dc3e17aa is going to be updated. [ 1232.445462] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1232.445686] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1232.445854] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1232.446119] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1232.446309] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1232.463651] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 276c2084-ac8d-475a-af24-a062dc3e17aa in Status: IN_PROGRESS for 2s [ 1234.484977] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 276c2084-ac8d-475a-af24-a062dc3e17aa in Status: SUCCESS [ 1234.485313] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.586540] env[67094]: INFO networking_nsxv3.common.synchronization [req-9e07c0e1-b5ab-4d4b-802f-e24ad286fbf3 req-c4c2302d-c54b-410f-8cb6-ac52c374979a tempest-AttachVolumeNegativeTest-737516548 tempest-AttachVolumeNegativeTest-737516548-project-member] Enqueued Resource ID: 7e9a1130-f6aa-45df-b627-3bebf6cbd9ff with Priority: HIGHEST for action security_group_members [ 1234.586719] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e9a1130-f6aa-45df-b627-3bebf6cbd9ff with Priority: HIGHEST for action security_group_members [ 1234.587244] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-7e9a1130-f6aa-45df-b627-3bebf6cbd9ff taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.587403] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-7e9a1130-f6aa-45df-b627-3bebf6cbd9ff" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.587479] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-7e9a1130-f6aa-45df-b627-3bebf6cbd9ff" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.589035] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-7e9a1130-f6aa-45df-b627-3bebf6cbd9ff" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.589035] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1234.589035] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1234.589035] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1234.589035] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1234.589035] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1234.589035] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('7e9a1130-f6aa-45df-b627-3bebf6cbd9ff',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1235.091280] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.091464] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.091541] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.091801] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.091924] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.092485] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.092485] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.092485] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.092630] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.092694] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.092784] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e9a1130-f6aa-45df-b627-3bebf6cbd9ff is going to be updated. [ 1235.123654] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1235.123859] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1235.123916] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1235.124175] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1235.124324] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1235.135063] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e9a1130-f6aa-45df-b627-3bebf6cbd9ff in Status: IN_PROGRESS for 2s [ 1237.147787] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 7e9a1130-f6aa-45df-b627-3bebf6cbd9ff in Status: SUCCESS [ 1237.148776] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 7e9a1130-f6aa-45df-b627-3bebf6cbd9ff deletion is rescheduled due to dependency. [ 1237.148776] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-7e9a1130-f6aa-45df-b627-3bebf6cbd9ff" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.345419] env[67094]: INFO networking_nsxv3.common.synchronization [None req-43f0ad78-df25-4501-b440-f233d52f9a1f tempest-AttachVolumeNegativeTest-737516548 tempest-AttachVolumeNegativeTest-737516548-project-member] Enqueued Resource ID: b246490e-f4de-45f5-ba36-79df6a6e88f9 with Priority: HIGHEST for action security_group_rules [ 1239.346063] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b246490e-f4de-45f5-ba36-79df6a6e88f9 with Priority: HIGHEST for action security_group_rules [ 1239.346452] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b246490e-f4de-45f5-ba36-79df6a6e88f9 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.346638] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b246490e-f4de-45f5-ba36-79df6a6e88f9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.346754] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b246490e-f4de-45f5-ba36-79df6a6e88f9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.347088] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b246490e-f4de-45f5-ba36-79df6a6e88f9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.347178] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b246490e-f4de-45f5-ba36-79df6a6e88f9',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1239.434999] env[67094]: INFO networking_nsxv3.common.synchronization [None req-7627aeca-63b7-44e5-9d9b-8500a0cbe9ee tempest-AttachVolumeNegativeTest-737516548 tempest-AttachVolumeNegativeTest-737516548-project-member] Enqueued Resource ID: b246490e-f4de-45f5-ba36-79df6a6e88f9 with Priority: HIGHEST for action security_group_rules [ 1239.435825] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b246490e-f4de-45f5-ba36-79df6a6e88f9 with Priority: HIGHEST for action security_group_rules [ 1239.436782] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b246490e-f4de-45f5-ba36-79df6a6e88f9 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.436782] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b246490e-f4de-45f5-ba36-79df6a6e88f9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.871025] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1239.871353] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1239.871353] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.871544] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.871628] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.871726] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b246490e-f4de-45f5-ba36-79df6a6e88f9 already deleted. [ 1239.871810] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b246490e-f4de-45f5-ba36-79df6a6e88f9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1239.871958] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b246490e-f4de-45f5-ba36-79df6a6e88f9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1239.872124] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b246490e-f4de-45f5-ba36-79df6a6e88f9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1239.872223] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b246490e-f4de-45f5-ba36-79df6a6e88f9',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.180800] env[67094]: INFO networking_nsxv3.common.synchronization [req-466df4a2-305f-4b34-9892-ef00e3f021df req-baeec1c5-a145-4292-9704-339359f6bb54 tempest-AttachVolumeShelveTestJSON-2030912383 tempest-AttachVolumeShelveTestJSON-2030912383-project-member] Enqueued Resource ID: 78b18c8a-dfa7-43b1-860f-15a4c0e0a93f with Priority: HIGHEST for action security_group_members [ 1240.181396] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78b18c8a-dfa7-43b1-860f-15a4c0e0a93f with Priority: HIGHEST for action security_group_members [ 1240.181746] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-78b18c8a-dfa7-43b1-860f-15a4c0e0a93f taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.182007] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-78b18c8a-dfa7-43b1-860f-15a4c0e0a93f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.182212] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-78b18c8a-dfa7-43b1-860f-15a4c0e0a93f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.182474] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-78b18c8a-dfa7-43b1-860f-15a4c0e0a93f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.182784] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.182991] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.183149] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.183435] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.183731] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.184011] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('78b18c8a-dfa7-43b1-860f-15a4c0e0a93f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1240.395991] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.395991] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.395991] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.395991] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.395991] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.395991] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b246490e-f4de-45f5-ba36-79df6a6e88f9 already deleted. [ 1240.395991] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b246490e-f4de-45f5-ba36-79df6a6e88f9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.687376] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.687609] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.687609] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.687809] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.687900] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.688122] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.688225] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.688304] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.688549] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.688669] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.688793] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78b18c8a-dfa7-43b1-860f-15a4c0e0a93f is going to be updated. [ 1240.716089] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1240.716315] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1240.716315] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1240.716485] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1240.716625] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1240.725353] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78b18c8a-dfa7-43b1-860f-15a4c0e0a93f in Status: IN_PROGRESS for 2s [ 1242.736589] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 78b18c8a-dfa7-43b1-860f-15a4c0e0a93f in Status: SUCCESS [ 1242.736960] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 78b18c8a-dfa7-43b1-860f-15a4c0e0a93f deletion is rescheduled due to dependency. [ 1242.736960] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-78b18c8a-dfa7-43b1-860f-15a4c0e0a93f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1244.957040] env[67094]: INFO networking_nsxv3.common.synchronization [None req-01ee70c7-a937-4c8d-aea9-a78b0b896a01 tempest-AttachVolumeShelveTestJSON-2030912383 tempest-AttachVolumeShelveTestJSON-2030912383-project-member] Enqueued Resource ID: 8e58d7c4-605c-4710-b582-c6c0d7f52ed3 with Priority: HIGHEST for action security_group_rules [ 1244.957040] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e58d7c4-605c-4710-b582-c6c0d7f52ed3 with Priority: HIGHEST for action security_group_rules [ 1244.957040] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8e58d7c4-605c-4710-b582-c6c0d7f52ed3 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1244.957040] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8e58d7c4-605c-4710-b582-c6c0d7f52ed3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1244.957040] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8e58d7c4-605c-4710-b582-c6c0d7f52ed3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1244.957516] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8e58d7c4-605c-4710-b582-c6c0d7f52ed3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1244.957516] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8e58d7c4-605c-4710-b582-c6c0d7f52ed3',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1245.053551] env[67094]: INFO networking_nsxv3.common.synchronization [None req-0120162c-e51b-44e9-9811-5987473c4dac tempest-AttachVolumeShelveTestJSON-2030912383 tempest-AttachVolumeShelveTestJSON-2030912383-project-member] Enqueued Resource ID: 8e58d7c4-605c-4710-b582-c6c0d7f52ed3 with Priority: HIGHEST for action security_group_rules [ 1245.054112] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e58d7c4-605c-4710-b582-c6c0d7f52ed3 with Priority: HIGHEST for action security_group_rules [ 1245.054656] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8e58d7c4-605c-4710-b582-c6c0d7f52ed3 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.054656] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8e58d7c4-605c-4710-b582-c6c0d7f52ed3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.480315] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1245.480454] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1245.480531] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.480757] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.480850] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.480948] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8e58d7c4-605c-4710-b582-c6c0d7f52ed3 already deleted. [ 1245.481066] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8e58d7c4-605c-4710-b582-c6c0d7f52ed3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1245.481327] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8e58d7c4-605c-4710-b582-c6c0d7f52ed3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1245.481543] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8e58d7c4-605c-4710-b582-c6c0d7f52ed3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1245.481682] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8e58d7c4-605c-4710-b582-c6c0d7f52ed3',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.002036] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.002448] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.002448] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.002526] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.002625] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.002744] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8e58d7c4-605c-4710-b582-c6c0d7f52ed3 already deleted. [ 1246.002834] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8e58d7c4-605c-4710-b582-c6c0d7f52ed3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.500937] env[67094]: INFO networking_nsxv3.common.synchronization [req-8455d5d7-7e00-40ab-a848-084f9f5ed39e req-3d3a9ecb-c859-48a9-a16f-69c1fcceeba7 tempest-ServerActionsTestJSON-785713127 tempest-ServerActionsTestJSON-785713127-project-member] Enqueued Resource ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 with Priority: HIGHEST for action security_group_members [ 1246.501507] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 with Priority: HIGHEST for action security_group_members [ 1246.501808] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-018c19d8-0b0e-41bd-8f01-0c9c58710c57 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.501931] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.501996] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.502196] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.502344] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.502441] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.502518] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.502653] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.502729] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.502818] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('018c19d8-0b0e-41bd-8f01-0c9c58710c57',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.642844] env[67094]: INFO networking_nsxv3.common.synchronization [req-a2e279a8-bdd3-49bb-a4e2-adf29c50f9c9 req-be6def51-adbc-4755-897e-1e87974d0940 tempest-AttachVolumeNegativeTest-737516548 tempest-AttachVolumeNegativeTest-737516548-project-member] Enqueued Resource ID: b246490e-f4de-45f5-ba36-79df6a6e88f9 with Priority: HIGHEST for action security_group_members [ 1246.642844] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b246490e-f4de-45f5-ba36-79df6a6e88f9 with Priority: HIGHEST for action security_group_members [ 1246.642844] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-b246490e-f4de-45f5-ba36-79df6a6e88f9 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.643108] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b246490e-f4de-45f5-ba36-79df6a6e88f9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.643273] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b246490e-f4de-45f5-ba36-79df6a6e88f9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.643710] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b246490e-f4de-45f5-ba36-79df6a6e88f9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.644959] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.644959] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.645073] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.645163] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.645271] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.645365] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b246490e-f4de-45f5-ba36-79df6a6e88f9',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1246.946241] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock network-871 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.946241] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "network-871" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.946241] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "network-871" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.946241] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "network-871" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.946493] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.946689] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.946833] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.947886] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.947886] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.947886] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1246.947886] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1246.947886] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1246.947886] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1246.948419] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1246.948419] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1246.948419] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1246.970896] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1246.971169] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Cache value generated in 0.023 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1246.971262] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1246.971428] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "network-871" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1246.971762] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock port-18c28b1f-6cdb-41bb-8c8d-436627700e6b taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1246.971966] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "port-18c28b1f-6cdb-41bb-8c8d-436627700e6b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1246.972175] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "port-18c28b1f-6cdb-41bb-8c8d-436627700e6b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1246.972529] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "port-18c28b1f-6cdb-41bb-8c8d-436627700e6b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1246.972685] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18c28b1f-6cdb-41bb-8c8d-436627700e6b',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1247.004944] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.004944] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.005580] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.005580] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.005580] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.005759] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.005812] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.005889] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.006038] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.006124] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.006215] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 is going to be updated. [ 1247.034101] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.034443] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.034443] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.034629] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.034721] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.044833] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 in Status: IN_PROGRESS for 2s [ 1247.148195] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.148387] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.148435] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.148696] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.148840] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.149069] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.149339] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.149339] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.149555] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.149679] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.149791] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b246490e-f4de-45f5-ba36-79df6a6e88f9 already deleted. [ 1247.149882] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b246490e-f4de-45f5-ba36-79df6a6e88f9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.474895] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.475164] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.475334] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.475570] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.475722] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.475875] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Segment Port 18c28b1f-6cdb-41bb-8c8d-436627700e6b not found, creating... [ 1247.476150] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.476302] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.476419] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.476631] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.476768] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.477057] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.477215] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.477334] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.477561] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.477702] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.477841] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Resource: SegmentPort with ID: 18c28b1f-6cdb-41bb-8c8d-436627700e6b is going to be created. [ 1247.500018] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1247.500268] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1247.500399] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1247.500695] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1247.500919] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1247.501152] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "port-18c28b1f-6cdb-41bb-8c8d-436627700e6b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.206699] env[67094]: INFO networking_nsxv3.common.synchronization [req-a2e279a8-bdd3-49bb-a4e2-adf29c50f9c9 req-51858ff9-d643-4e97-ae6f-0012d3079899 service nova] Enqueued Resource ID: b246490e-f4de-45f5-ba36-79df6a6e88f9 with Priority: HIGHEST for action security_group_rules [ 1248.206949] env[67094]: INFO networking_nsxv3.common.synchronization [req-a2e279a8-bdd3-49bb-a4e2-adf29c50f9c9 req-51858ff9-d643-4e97-ae6f-0012d3079899 service nova] Enqueued Resource ID: b246490e-f4de-45f5-ba36-79df6a6e88f9 with Priority: HIGHEST for action security_group_members [ 1248.206949] env[67094]: INFO networking_nsxv3.common.synchronization [req-a2e279a8-bdd3-49bb-a4e2-adf29c50f9c9 req-51858ff9-d643-4e97-ae6f-0012d3079899 service nova] Enqueued Resource ID: 18c28b1f-6cdb-41bb-8c8d-436627700e6b with Priority: HIGHEST for action port [ 1248.207426] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b246490e-f4de-45f5-ba36-79df6a6e88f9 with Priority: HIGHEST for action security_group_rules [ 1248.207562] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b246490e-f4de-45f5-ba36-79df6a6e88f9 with Priority: HIGHEST for action security_group_members [ 1248.207659] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 18c28b1f-6cdb-41bb-8c8d-436627700e6b with Priority: HIGHEST for action port [ 1248.207927] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b246490e-f4de-45f5-ba36-79df6a6e88f9 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.208130] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b246490e-f4de-45f5-ba36-79df6a6e88f9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.208130] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b246490e-f4de-45f5-ba36-79df6a6e88f9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.208319] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b246490e-f4de-45f5-ba36-79df6a6e88f9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.208453] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b246490e-f4de-45f5-ba36-79df6a6e88f9',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.209720] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-b246490e-f4de-45f5-ba36-79df6a6e88f9 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.209720] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b246490e-f4de-45f5-ba36-79df6a6e88f9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.209945] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b246490e-f4de-45f5-ba36-79df6a6e88f9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.209945] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b246490e-f4de-45f5-ba36-79df6a6e88f9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.210097] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.210189] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.210250] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.210389] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.210475] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.210572] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b246490e-f4de-45f5-ba36-79df6a6e88f9',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.211320] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-18c28b1f-6cdb-41bb-8c8d-436627700e6b taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.211445] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-18c28b1f-6cdb-41bb-8c8d-436627700e6b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.211501] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-18c28b1f-6cdb-41bb-8c8d-436627700e6b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.211722] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-18c28b1f-6cdb-41bb-8c8d-436627700e6b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.211790] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('18c28b1f-6cdb-41bb-8c8d-436627700e6b',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.713229] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('b246490e-f4de-45f5-ba36-79df6a6e88f9',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1248.714419] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-b246490e-f4de-45f5-ba36-79df6a6e88f9 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.714419] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b246490e-f4de-45f5-ba36-79df6a6e88f9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.717223] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 18c28b1f-6cdb-41bb-8c8d-436627700e6b with status ACTIVE [ 1248.717453] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.717587] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.717650] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.717860] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.717964] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.718381] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.718542] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.718613] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.718795] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.718881] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.719190] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.719273] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.719273] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.719439] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.719518] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.719607] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 18c28b1f-6cdb-41bb-8c8d-436627700e6b is going to be updated. [ 1248.741288] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1248.741518] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1248.741518] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1248.741690] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1248.741817] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1248.741971] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-18c28b1f-6cdb-41bb-8c8d-436627700e6b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.055250] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 in Status: SUCCESS [ 1249.055445] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 deletion is rescheduled due to dependency. [ 1249.055625] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.217297] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('b246490e-f4de-45f5-ba36-79df6a6e88f9',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1249.719577] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.719744] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.719882] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.720144] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.720273] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.720400] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b246490e-f4de-45f5-ba36-79df6a6e88f9 is going to be created. [ 1249.747279] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1249.747521] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1249.747629] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1249.747766] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1249.747920] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1249.758799] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b246490e-f4de-45f5-ba36-79df6a6e88f9 in Status: UNINITIALIZED for 2s [ 1250.608825] env[67094]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] NSXv3 Agent Agent loop - iteration:2 completed [ 1250.608825] env[67094]: INFO neutron.plugins.ml2.drivers.agent._common_agent [None req-44a25dda-3473-4540-9c0e-5556a955471f None None] NSXv3 Agent Agent loop - iteration:3 started [ 1251.363067] env[67094]: INFO networking_nsxv3.common.synchronization [req-18842f23-0e05-40d5-b40f-61d9b4f75c46 req-be10bab3-4088-466e-b598-bf8436b6c498 tempest-AttachVolumeShelveTestJSON-2030912383 tempest-AttachVolumeShelveTestJSON-2030912383-project-member] Enqueued Resource ID: 8e58d7c4-605c-4710-b582-c6c0d7f52ed3 with Priority: HIGHEST for action security_group_members [ 1251.363747] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e58d7c4-605c-4710-b582-c6c0d7f52ed3 with Priority: HIGHEST for action security_group_members [ 1251.364054] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e58d7c4-605c-4710-b582-c6c0d7f52ed3 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.364220] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e58d7c4-605c-4710-b582-c6c0d7f52ed3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.364294] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e58d7c4-605c-4710-b582-c6c0d7f52ed3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.364594] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e58d7c4-605c-4710-b582-c6c0d7f52ed3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.364764] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.364907] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.364998] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.365127] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.365232] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.365346] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e58d7c4-605c-4710-b582-c6c0d7f52ed3',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.677900] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock network-787 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.678270] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "network-787" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.678270] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "network-787" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.678538] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "network-787" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.678804] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.678957] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.679101] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.679366] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.679518] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.679722] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1251.679832] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1251.679935] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1251.680066] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1251.680176] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1251.680282] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1251.680415] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1251.700193] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1251.700416] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Cache value generated in 0.020 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1251.700606] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1251.700806] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "network-787" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.701162] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock port-166fe62f-8064-44cf-b347-a266959cf3b4 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.701427] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "port-166fe62f-8064-44cf-b347-a266959cf3b4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.701571] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "port-166fe62f-8064-44cf-b347-a266959cf3b4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.701886] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "port-166fe62f-8064-44cf-b347-a266959cf3b4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.702079] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('166fe62f-8064-44cf-b347-a266959cf3b4',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.768038] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b246490e-f4de-45f5-ba36-79df6a6e88f9 in Status: SUCCESS [ 1251.768284] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b246490e-f4de-45f5-ba36-79df6a6e88f9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.768442] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b246490e-f4de-45f5-ba36-79df6a6e88f9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.768649] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b246490e-f4de-45f5-ba36-79df6a6e88f9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.768842] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.768955] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.769032] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.769212] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.769331] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.769430] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b246490e-f4de-45f5-ba36-79df6a6e88f9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.769524] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('b246490e-f4de-45f5-ba36-79df6a6e88f9',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1251.868099] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.868275] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.868322] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.868533] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.868622] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.868836] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1251.868939] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1251.869014] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1251.869182] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1251.869268] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1251.869426] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e58d7c4-605c-4710-b582-c6c0d7f52ed3 already deleted. [ 1251.869522] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e58d7c4-605c-4710-b582-c6c0d7f52ed3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.204917] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.207052] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.207052] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.207052] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.207052] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.207052] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Segment Port 166fe62f-8064-44cf-b347-a266959cf3b4 not found, creating... [ 1252.207052] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.207052] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.207052] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.207052] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.207052] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.207521] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.207521] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.207521] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.207521] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.207663] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.207771] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Resource: SegmentPort with ID: 166fe62f-8064-44cf-b347-a266959cf3b4 is going to be created. [ 1252.230778] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.231035] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.231244] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.231579] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.231824] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.232202] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "port-166fe62f-8064-44cf-b347-a266959cf3b4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.271501] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('b246490e-f4de-45f5-ba36-79df6a6e88f9',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.774390] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for b246490e-f4de-45f5-ba36-79df6a6e88f9: rpc.has_security_group_logging(os_id): False [ 1252.794179] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.794437] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.794584] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.794906] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.795083] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.795461] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.795642] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.795763] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.796041] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.796192] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.796346] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b246490e-f4de-45f5-ba36-79df6a6e88f9 is going to be created. [ 1252.872381] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.872550] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.872643] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.872830] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.873017] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.884578] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b246490e-f4de-45f5-ba36-79df6a6e88f9 in Status: IN_PROGRESS for 2s [ 1252.921674] env[67094]: INFO networking_nsxv3.common.synchronization [req-18842f23-0e05-40d5-b40f-61d9b4f75c46 req-b47ee767-63bd-4fcb-ac9b-40a0737d4a9d service nova] Enqueued Resource ID: 8e58d7c4-605c-4710-b582-c6c0d7f52ed3 with Priority: HIGHEST for action security_group_rules [ 1252.922037] env[67094]: INFO networking_nsxv3.common.synchronization [req-18842f23-0e05-40d5-b40f-61d9b4f75c46 req-b47ee767-63bd-4fcb-ac9b-40a0737d4a9d service nova] Enqueued Resource ID: 8e58d7c4-605c-4710-b582-c6c0d7f52ed3 with Priority: HIGHEST for action security_group_members [ 1252.922326] env[67094]: INFO networking_nsxv3.common.synchronization [req-18842f23-0e05-40d5-b40f-61d9b4f75c46 req-b47ee767-63bd-4fcb-ac9b-40a0737d4a9d service nova] Enqueued Resource ID: 166fe62f-8064-44cf-b347-a266959cf3b4 with Priority: HIGHEST for action port [ 1252.922984] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e58d7c4-605c-4710-b582-c6c0d7f52ed3 with Priority: HIGHEST for action security_group_rules [ 1252.923391] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e58d7c4-605c-4710-b582-c6c0d7f52ed3 with Priority: HIGHEST for action security_group_members [ 1252.923561] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 166fe62f-8064-44cf-b347-a266959cf3b4 with Priority: HIGHEST for action port [ 1252.923856] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8e58d7c4-605c-4710-b582-c6c0d7f52ed3 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.923990] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8e58d7c4-605c-4710-b582-c6c0d7f52ed3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.924071] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8e58d7c4-605c-4710-b582-c6c0d7f52ed3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.924272] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8e58d7c4-605c-4710-b582-c6c0d7f52ed3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.924355] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8e58d7c4-605c-4710-b582-c6c0d7f52ed3',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.925236] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e58d7c4-605c-4710-b582-c6c0d7f52ed3 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.925351] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e58d7c4-605c-4710-b582-c6c0d7f52ed3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.925418] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e58d7c4-605c-4710-b582-c6c0d7f52ed3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.925585] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e58d7c4-605c-4710-b582-c6c0d7f52ed3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.925726] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.925880] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.925880] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.926011] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.926108] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1252.926198] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e58d7c4-605c-4710-b582-c6c0d7f52ed3',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1252.927536] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-166fe62f-8064-44cf-b347-a266959cf3b4 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1252.927536] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-166fe62f-8064-44cf-b347-a266959cf3b4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1252.927536] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-166fe62f-8064-44cf-b347-a266959cf3b4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1252.927658] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-166fe62f-8064-44cf-b347-a266959cf3b4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1252.927697] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('166fe62f-8064-44cf-b347-a266959cf3b4',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.430080] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e58d7c4-605c-4710-b582-c6c0d7f52ed3 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.430334] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e58d7c4-605c-4710-b582-c6c0d7f52ed3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.430388] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8e58d7c4-605c-4710-b582-c6c0d7f52ed3',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1253.431325] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 166fe62f-8064-44cf-b347-a266959cf3b4 with status ACTIVE [ 1253.431554] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.431671] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.431738] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.431942] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.432046] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.432231] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.432364] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.432429] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.432589] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.432669] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.432850] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.432968] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.433054] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.433200] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.433274] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.433360] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 166fe62f-8064-44cf-b347-a266959cf3b4 is going to be updated. [ 1253.456601] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1253.456844] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1253.456844] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1253.457029] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1253.457176] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.457346] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-166fe62f-8064-44cf-b347-a266959cf3b4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1253.935534] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8e58d7c4-605c-4710-b582-c6c0d7f52ed3',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1254.437636] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.437861] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.437972] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.438262] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.438364] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.438466] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e58d7c4-605c-4710-b582-c6c0d7f52ed3 is going to be created. [ 1254.462142] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1254.462315] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1254.462360] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1254.462563] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1254.462724] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1254.473315] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e58d7c4-605c-4710-b582-c6c0d7f52ed3 in Status: UNINITIALIZED for 2s [ 1254.896135] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: b246490e-f4de-45f5-ba36-79df6a6e88f9 in Status: SUCCESS [ 1254.896378] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b246490e-f4de-45f5-ba36-79df6a6e88f9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.482937] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e58d7c4-605c-4710-b582-c6c0d7f52ed3 in Status: SUCCESS [ 1256.483310] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e58d7c4-605c-4710-b582-c6c0d7f52ed3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.483355] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e58d7c4-605c-4710-b582-c6c0d7f52ed3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.483548] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e58d7c4-605c-4710-b582-c6c0d7f52ed3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.483841] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.483910] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.483945] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.484127] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.484201] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.484286] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e58d7c4-605c-4710-b582-c6c0d7f52ed3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.484384] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8e58d7c4-605c-4710-b582-c6c0d7f52ed3',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.615858] env[67094]: INFO networking_nsxv3.common.synchronization [req-5baefac7-9ac0-4218-8483-e77bb29562d1 req-cfd94e6c-198c-4c64-8e4c-d545a1d98058 tempest-ServerActionsTestJSON-785713127 tempest-ServerActionsTestJSON-785713127-project-member] Enqueued Resource ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 with Priority: HIGHEST for action security_group_members [ 1256.616487] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 with Priority: HIGHEST for action security_group_members [ 1256.616810] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-018c19d8-0b0e-41bd-8f01-0c9c58710c57 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.616933] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.617121] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.617361] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.617521] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.617627] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.617683] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.617834] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.617918] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.618018] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('018c19d8-0b0e-41bd-8f01-0c9c58710c57',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.925168] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock network-657 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.925385] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "network-657" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.925511] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "network-657" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.925779] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "network-657" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.926053] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.926212] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.926327] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.926545] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.926687] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.926888] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1256.926997] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1256.927120] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1256.927228] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1256.927337] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1256.927442] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1256.927572] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1256.946428] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1256.946584] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Cache value generated in 0.019 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1256.946721] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1256.946898] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "network-657" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1256.947236] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock port-89c2ac8c-e1f3-4683-8363-33922229742b taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1256.947408] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "port-89c2ac8c-e1f3-4683-8363-33922229742b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1256.947529] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "port-89c2ac8c-e1f3-4683-8363-33922229742b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1256.947867] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "port-89c2ac8c-e1f3-4683-8363-33922229742b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1256.948092] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89c2ac8c-e1f3-4683-8363-33922229742b',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1256.986522] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8e58d7c4-605c-4710-b582-c6c0d7f52ed3',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1257.120919] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.121344] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.121514] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.121740] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.121848] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.122083] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.122201] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.122251] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.122639] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.122773] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.122877] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 is going to be updated. [ 1257.159770] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.159992] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.159992] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.160213] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.160358] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.171750] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 in Status: IN_PROGRESS for 2s [ 1257.450500] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.450723] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.450849] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.451139] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.451335] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.451488] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Segment Port 89c2ac8c-e1f3-4683-8363-33922229742b not found, creating... [ 1257.451751] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.452486] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.452486] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.452486] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.452486] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.452756] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.452844] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.452900] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.453424] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.453424] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.453583] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Resource: SegmentPort with ID: 89c2ac8c-e1f3-4683-8363-33922229742b is going to be created. [ 1257.477475] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.477689] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.477812] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.478093] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.478319] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.478572] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "port-89c2ac8c-e1f3-4683-8363-33922229742b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.489052] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8e58d7c4-605c-4710-b582-c6c0d7f52ed3: rpc.has_security_group_logging(os_id): False [ 1257.506946] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.506946] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.506946] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.507151] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.507241] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.507484] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.507607] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.507649] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.507833] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.507955] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.508118] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8e58d7c4-605c-4710-b582-c6c0d7f52ed3 is going to be created. [ 1257.609621] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1257.609621] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1257.609892] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1257.609944] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1257.610410] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1257.623830] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8e58d7c4-605c-4710-b582-c6c0d7f52ed3 in Status: IN_PROGRESS for 2s [ 1258.200437] env[67094]: INFO networking_nsxv3.common.synchronization [req-5baefac7-9ac0-4218-8483-e77bb29562d1 req-ae78069c-7f44-4600-bec9-86b0dd56406a service nova] Enqueued Resource ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 with Priority: HIGHEST for action security_group_rules [ 1258.200678] env[67094]: INFO networking_nsxv3.common.synchronization [req-5baefac7-9ac0-4218-8483-e77bb29562d1 req-ae78069c-7f44-4600-bec9-86b0dd56406a service nova] Enqueued Resource ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 with Priority: HIGHEST for action security_group_members [ 1258.200837] env[67094]: INFO networking_nsxv3.common.synchronization [req-5baefac7-9ac0-4218-8483-e77bb29562d1 req-ae78069c-7f44-4600-bec9-86b0dd56406a service nova] Enqueued Resource ID: 89c2ac8c-e1f3-4683-8363-33922229742b with Priority: HIGHEST for action port [ 1258.201574] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 with Priority: HIGHEST for action security_group_rules [ 1258.201758] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 with Priority: HIGHEST for action security_group_members [ 1258.201896] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 89c2ac8c-e1f3-4683-8363-33922229742b with Priority: HIGHEST for action port [ 1258.202332] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-018c19d8-0b0e-41bd-8f01-0c9c58710c57 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.202485] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.202593] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.202850] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.202938] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('018c19d8-0b0e-41bd-8f01-0c9c58710c57',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.203857] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-018c19d8-0b0e-41bd-8f01-0c9c58710c57 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.203960] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.204169] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-89c2ac8c-e1f3-4683-8363-33922229742b taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.204268] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-89c2ac8c-e1f3-4683-8363-33922229742b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.204303] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-89c2ac8c-e1f3-4683-8363-33922229742b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.204471] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-89c2ac8c-e1f3-4683-8363-33922229742b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.204564] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('89c2ac8c-e1f3-4683-8363-33922229742b',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1258.706165] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-018c19d8-0b0e-41bd-8f01-0c9c58710c57 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.706564] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.706564] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 89c2ac8c-e1f3-4683-8363-33922229742b with status ACTIVE [ 1258.706702] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.706811] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.706875] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.707126] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.707278] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.707455] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.707582] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.707686] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.707806] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.707902] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.708117] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.708206] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.708312] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.708414] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.708488] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.708575] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 89c2ac8c-e1f3-4683-8363-33922229742b is going to be updated. [ 1258.730856] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1258.731074] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1258.731074] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1258.731271] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1258.731488] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1258.731683] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-89c2ac8c-e1f3-4683-8363-33922229742b" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.182094] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 in Status: SUCCESS [ 1259.182247] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 deletion is rescheduled due to dependency. [ 1259.182352] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.182525] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.182728] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.182917] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1259.183072] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1259.183114] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1259.183252] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1259.183332] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.183435] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('018c19d8-0b0e-41bd-8f01-0c9c58710c57',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1259.638066] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8e58d7c4-605c-4710-b582-c6c0d7f52ed3 in Status: SUCCESS [ 1259.638344] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8e58d7c4-605c-4710-b582-c6c0d7f52ed3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1259.685881] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('018c19d8-0b0e-41bd-8f01-0c9c58710c57',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.188776] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('018c19d8-0b0e-41bd-8f01-0c9c58710c57',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.685817] env[67094]: INFO networking_nsxv3.common.synchronization [req-1d9608a4-8dd6-4879-83f6-4c9af7d83c8a req-e74aaac6-6608-442c-91db-79948b19edb3 tempest-ServerActionsTestOtherA-276518123 tempest-ServerActionsTestOtherA-276518123-project-member] Enqueued Resource ID: 005d1062-21f3-48fc-b7a0-06c9f0fc7843 with Priority: HIGHEST for action security_group_members [ 1260.686514] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 005d1062-21f3-48fc-b7a0-06c9f0fc7843 with Priority: HIGHEST for action security_group_members [ 1260.686883] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-005d1062-21f3-48fc-b7a0-06c9f0fc7843 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.687271] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-005d1062-21f3-48fc-b7a0-06c9f0fc7843" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.687271] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-005d1062-21f3-48fc-b7a0-06c9f0fc7843" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.687425] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-005d1062-21f3-48fc-b7a0-06c9f0fc7843" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.687672] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.687672] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.687672] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.687850] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.687961] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.688088] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('005d1062-21f3-48fc-b7a0-06c9f0fc7843',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1260.691738] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.691859] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.691901] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.692207] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.692207] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.692364] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 is going to be updated. [ 1260.724315] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1260.724519] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1260.724519] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1260.724619] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1260.724764] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1260.733817] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 in Status: IN_PROGRESS for 2s [ 1261.190678] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('005d1062-21f3-48fc-b7a0-06c9f0fc7843',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1261.693567] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('005d1062-21f3-48fc-b7a0-06c9f0fc7843',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1262.196648] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.197136] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.197136] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.197283] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.197418] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.197531] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 005d1062-21f3-48fc-b7a0-06c9f0fc7843 is going to be updated. [ 1262.239263] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.239479] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.239479] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.239687] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.239837] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.248410] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 005d1062-21f3-48fc-b7a0-06c9f0fc7843 in Status: IN_PROGRESS for 2s [ 1262.743788] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 in Status: SUCCESS [ 1262.744126] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.744352] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.744601] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.744824] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1262.744976] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1262.745110] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1262.745294] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1262.745381] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.745470] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1262.745559] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('018c19d8-0b0e-41bd-8f01-0c9c58710c57',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.248232] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('018c19d8-0b0e-41bd-8f01-0c9c58710c57',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1263.750343] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 018c19d8-0b0e-41bd-8f01-0c9c58710c57: rpc.has_security_group_logging(os_id): False [ 1263.768634] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.768634] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.768880] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.768942] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.769063] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.769309] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.769412] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.769479] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.769666] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.769718] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.769795] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 is going to be updated. [ 1263.831557] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1263.831811] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1263.831862] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1263.832184] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1263.832359] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1263.844252] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 in Status: IN_PROGRESS for 2s [ 1264.258464] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 005d1062-21f3-48fc-b7a0-06c9f0fc7843 in Status: SUCCESS [ 1264.258869] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-005d1062-21f3-48fc-b7a0-06c9f0fc7843" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.554557] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock all taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.554811] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "all" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.554811] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "all" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.555023] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "all" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.555138] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_ports_with_revisions called with arguments (1000, 0) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.663370] env[67094]: INFO networking_nsxv3.common.synchronization [req-44838e44-ce55-4bf0-8816-df850544043d req-bbc74f77-b91d-4fd3-859b-cabec9d52dcb tempest-DeleteServersTestJSON-1237946437 tempest-DeleteServersTestJSON-1237946437-project-member] Enqueued Resource ID: 276c2084-ac8d-475a-af24-a062dc3e17aa with Priority: HIGHEST for action security_group_members [ 1265.664037] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 276c2084-ac8d-475a-af24-a062dc3e17aa with Priority: HIGHEST for action security_group_members [ 1265.664037] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-276c2084-ac8d-475a-af24-a062dc3e17aa taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.664037] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.664037] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.664238] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.665154] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1265.665154] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1265.665154] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1265.665154] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1265.665154] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1265.665154] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('276c2084-ac8d-475a-af24-a062dc3e17aa',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1265.863432] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 in Status: SUCCESS [ 1265.863684] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.058041] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_groups_with_revisions called with arguments (1000, 0) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1266.167118] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.167327] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.167327] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.167468] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.167565] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.167760] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.167862] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.167926] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.168103] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.168254] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.168306] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 276c2084-ac8d-475a-af24-a062dc3e17aa is going to be updated. [ 1266.201202] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1266.201438] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1266.201438] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1266.201712] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1266.201920] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1266.211050] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 276c2084-ac8d-475a-af24-a062dc3e17aa in Status: IN_PROGRESS for 2s [ 1266.560951] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_qos_policies_with_revisions called with arguments (1000, 0) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1267.063843] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata is going to be refreshed. [ 1267.063970] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment. [ 1267.926176] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.926176] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.926176] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.926176] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1267.948213] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider [-] Duplicate resource with OS_ID: 992 ID: cl2-zone-992 [ 1267.949571] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1267.951331] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:SegmentPort. [ 1267.994584] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1267.995179] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1267.995395] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1267.995747] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.010614] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.011999] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:SegmentPort Is:0. [ 1268.012341] env[67094]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:SegmentPort Are:set() {{(pid=67094) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1268.012579] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules). [ 1268.058168] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.058271] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.058271] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.058491] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.060022] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.060437] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Rules Remote IP Prefix). [ 1268.173272] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules Remote IP Prefix) taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.174033] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules Remote IP Prefix)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.175038] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules Remote IP Prefix)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.175038] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules Remote IP Prefix)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.175190] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules Remote IP Prefix)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.176365] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Address Group. [ 1268.229885] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 276c2084-ac8d-475a-af24-a062dc3e17aa in Status: SUCCESS [ 1268.229885] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 276c2084-ac8d-475a-af24-a062dc3e17aa deletion is rescheduled due to dependency. [ 1268.229885] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-276c2084-ac8d-475a-af24-a062dc3e17aa" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.309247] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Address Group taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.309247] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Address Group" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.309247] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Address Group" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.310281] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Address Group" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.310281] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Address Group" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.310407] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Rules) Is:49. [ 1268.310579] env[67094]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Rules) Are:{'7516d25f-7616-41dc-9575-16a9cddc1840', '280210af-8e3d-42c9-8854-42bd856b9dbe', '8c8bcd5f-7602-4632-8046-daa41c621837', '529c6563-9354-49e2-8282-acd28e0b0ef7', '6745d4e2-6069-4132-80d9-76cf2245b017', '5d6b6e19-f017-4eac-b0ac-ed1b17230d12', 'b61bfa2d-4c26-4a49-a153-4a8fb6153ccd', '8e58d7c4-605c-4710-b582-c6c0d7f52ed3', '0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9', '3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56', '7e9a1130-f6aa-45df-b627-3bebf6cbd9ff', '34b6178d-c850-4655-81a1-f452d6a6f576', '2bc6c42e-23db-4008-8db7-e57d76593898', '018c19d8-0b0e-41bd-8f01-0c9c58710c57', 'c49f7fe8-62a6-4df5-90fb-465116c226a3', 'a685dbf9-8823-4364-9677-e8aff5bd2a59', '78b18c8a-dfa7-43b1-860f-15a4c0e0a93f', 'a300461d-04cc-44a3-bc50-afbfc1076857', '1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6', '4ec74abc-987a-4435-8c42-e7e606ef3293', '71aa8195-5281-4a1c-b9a7-3d40e851f47e', 'eb77eddf-2e1d-485c-bfe8-67d4c174dc73', 'f71d6693-6145-4241-b055-f03e34f73c7f', '1c0d7199-02e7-494e-9784-a23947a72cd2', '005d1062-21f3-48fc-b7a0-06c9f0fc7843', '34103f55-eb7e-4602-9672-09596df7eaa4', '882c69d3-9554-45c6-97a1-55fb0f065040', '78a2df96-bab9-40fe-b845-1eec3b7d8df2', '276c2084-ac8d-475a-af24-a062dc3e17aa', '3ece2d85-d26d-4c59-ae47-b9a59cc4de8f', '00f05527-967f-4b60-a2ba-dd3e2d9bad21', '62f0dd40-a793-48dd-b62a-abaa0eeebd45', 'fbf0de02-2c4b-4156-ae88-4a3e624f550d', '4e31526a-4068-4c26-bce5-72c9c1c3964e', '0dd1c3b9-6caa-47bd-9fa3-b3fe29df5fd6', 'b246490e-f4de-45f5-ba36-79df6a6e88f9', 'cb367675-42aa-4b50-8812-8a73fdef747d', '7ec28241-1cbc-4bfa-acfa-d9a84a1a6dae', '0c6a3072-604c-444a-b4d4-9ed06e060bef', '0d0028b4-3629-4ade-8832-b0fbfb48d140', '75d792df-97d6-4e1a-bf50-631a4a868869', 'c0881101-1be1-4dbf-ac18-2d54a689202c', '52851555-797a-47ba-b408-d4557f3f4ec2', '04d0f31c-3c4e-40ac-a405-c43379f06123', 'fb2958aa-150f-4e44-b88a-573295ac9a32', '0f2ac94a-4beb-4e79-8490-47989224cf9f', '7d339cc8-3c0d-42f5-b975-687230de264b', '0e314269-1025-4c1f-b42e-8acab2134cbb', '60943622-73b5-4dda-ad21-63bf08db617e'} {{(pid=67094) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1268.310717] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Segment QoS. [ 1268.335249] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment QoS taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.335459] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment QoS" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.335584] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment QoS" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.335713] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment QoS" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.335793] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment QoS" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.335907] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Segment QoS Is:0. [ 1268.335977] env[67094]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Segment QoS Are:set() {{(pid=67094) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1268.336106] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] Fetching Policy NSX-T metadata for Type:Security Group (Members). [ 1268.439160] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1268.439505] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1268.439587] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1268.439769] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1268.441041] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1268.441328] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] [Policy] The number of outdated resources for Type:Security Group (Members) Is:0. [ 1268.441479] env[67094]: DEBUG networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Outdated resources of Type:Security Group (Members) Are:set() {{(pid=67094) outdated /opt/stack/networking-nsx-t/networking_nsxv3/plugins/ml2/drivers/nsxv3/agent/provider_nsx_policy.py:1130}} [ 1268.441565] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Inventory metadata have been refreshed. [ 1268.441632] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 0/0 resources of Type:Ports [ 1268.441708] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Realizing 20/49 resources of Type:Security Group Rules [ 1268.441778] env[67094]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7516d25f-7616-41dc-9575-16a9cddc1840 with Priority: HIGH for action security_group_rules [ 1268.441857] env[67094]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 280210af-8e3d-42c9-8854-42bd856b9dbe with Priority: HIGH for action security_group_rules [ 1268.441921] env[67094]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8c8bcd5f-7602-4632-8046-daa41c621837 with Priority: HIGH for action security_group_rules [ 1268.441982] env[67094]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 529c6563-9354-49e2-8282-acd28e0b0ef7 with Priority: HIGH for action security_group_rules [ 1268.442056] env[67094]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 6745d4e2-6069-4132-80d9-76cf2245b017 with Priority: HIGH for action security_group_rules [ 1268.442117] env[67094]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 5d6b6e19-f017-4eac-b0ac-ed1b17230d12 with Priority: HIGH for action security_group_rules [ 1268.442176] env[67094]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: b61bfa2d-4c26-4a49-a153-4a8fb6153ccd with Priority: HIGH for action security_group_rules [ 1268.442237] env[67094]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 8e58d7c4-605c-4710-b582-c6c0d7f52ed3 with Priority: HIGH for action security_group_rules [ 1268.442296] env[67094]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 with Priority: HIGH for action security_group_rules [ 1268.442406] env[67094]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56 with Priority: HIGH for action security_group_rules [ 1268.442531] env[67094]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 7e9a1130-f6aa-45df-b627-3bebf6cbd9ff with Priority: HIGH for action security_group_rules [ 1268.442531] env[67094]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 34b6178d-c850-4655-81a1-f452d6a6f576 with Priority: HIGH for action security_group_rules [ 1268.442668] env[67094]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 2bc6c42e-23db-4008-8db7-e57d76593898 with Priority: HIGH for action security_group_rules [ 1268.442668] env[67094]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 with Priority: HIGH for action security_group_rules [ 1268.442800] env[67094]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: c49f7fe8-62a6-4df5-90fb-465116c226a3 with Priority: HIGH for action security_group_rules [ 1268.442800] env[67094]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a685dbf9-8823-4364-9677-e8aff5bd2a59 with Priority: HIGH for action security_group_rules [ 1268.442800] env[67094]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 78b18c8a-dfa7-43b1-860f-15a4c0e0a93f with Priority: HIGH for action security_group_rules [ 1268.442967] env[67094]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: a300461d-04cc-44a3-bc50-afbfc1076857 with Priority: HIGH for action security_group_rules [ 1268.442967] env[67094]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 with Priority: HIGH for action security_group_rules [ 1268.443101] env[67094]: INFO networking_nsxv3.common.synchronization [-] Enqueued Resource ID: 4ec74abc-987a-4435-8c42-e7e606ef3293 with Priority: HIGH for action security_group_rules [ 1268.443164] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "all" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.664447] env[67094]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1270.664830] env[67094]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=20], Jobs=0 [ 1270.664830] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7516d25f-7616-41dc-9575-16a9cddc1840 with Priority: HIGH for action security_group_rules [ 1270.664830] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8c8bcd5f-7602-4632-8046-daa41c621837 with Priority: HIGH for action security_group_rules [ 1270.664953] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b61bfa2d-4c26-4a49-a153-4a8fb6153ccd with Priority: HIGH for action security_group_rules [ 1270.664953] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: c49f7fe8-62a6-4df5-90fb-465116c226a3 with Priority: HIGH for action security_group_rules [ 1270.665067] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 4ec74abc-987a-4435-8c42-e7e606ef3293 with Priority: HIGH for action security_group_rules [ 1270.665146] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 with Priority: HIGH for action security_group_rules [ 1270.665235] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a300461d-04cc-44a3-bc50-afbfc1076857 with Priority: HIGH for action security_group_rules [ 1270.665324] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 78b18c8a-dfa7-43b1-860f-15a4c0e0a93f with Priority: HIGH for action security_group_rules [ 1270.665413] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 with Priority: HIGH for action security_group_rules [ 1270.665508] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: a685dbf9-8823-4364-9677-e8aff5bd2a59 with Priority: HIGH for action security_group_rules [ 1270.665592] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 2bc6c42e-23db-4008-8db7-e57d76593898 with Priority: HIGH for action security_group_rules [ 1270.665680] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 34b6178d-c850-4655-81a1-f452d6a6f576 with Priority: HIGH for action security_group_rules [ 1270.665769] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 7e9a1130-f6aa-45df-b627-3bebf6cbd9ff with Priority: HIGH for action security_group_rules [ 1270.665858] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56 with Priority: HIGH for action security_group_rules [ 1270.665944] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 with Priority: HIGH for action security_group_rules [ 1270.666042] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 5d6b6e19-f017-4eac-b0ac-ed1b17230d12 with Priority: HIGH for action security_group_rules [ 1270.666133] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e58d7c4-605c-4710-b582-c6c0d7f52ed3 with Priority: HIGH for action security_group_rules [ 1270.666220] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 6745d4e2-6069-4132-80d9-76cf2245b017 with Priority: HIGH for action security_group_rules [ 1270.666302] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 280210af-8e3d-42c9-8854-42bd856b9dbe with Priority: HIGH for action security_group_rules [ 1270.666388] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 529c6563-9354-49e2-8282-acd28e0b0ef7 with Priority: HIGH for action security_group_rules [ 1270.666736] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7516d25f-7616-41dc-9575-16a9cddc1840 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.666866] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7516d25f-7616-41dc-9575-16a9cddc1840" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.666931] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7516d25f-7616-41dc-9575-16a9cddc1840" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.667160] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7516d25f-7616-41dc-9575-16a9cddc1840" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.667244] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7516d25f-7616-41dc-9575-16a9cddc1840',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.668599] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8c8bcd5f-7602-4632-8046-daa41c621837 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.668722] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8c8bcd5f-7602-4632-8046-daa41c621837" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.668784] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8c8bcd5f-7602-4632-8046-daa41c621837" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.668966] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8c8bcd5f-7602-4632-8046-daa41c621837" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.669057] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8c8bcd5f-7602-4632-8046-daa41c621837',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.669998] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-b61bfa2d-4c26-4a49-a153-4a8fb6153ccd taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.670151] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-b61bfa2d-4c26-4a49-a153-4a8fb6153ccd" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.670198] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-b61bfa2d-4c26-4a49-a153-4a8fb6153ccd" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.670526] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-b61bfa2d-4c26-4a49-a153-4a8fb6153ccd" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.670526] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('b61bfa2d-4c26-4a49-a153-4a8fb6153ccd',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.671132] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-c49f7fe8-62a6-4df5-90fb-465116c226a3 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.671241] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-c49f7fe8-62a6-4df5-90fb-465116c226a3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.671308] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-c49f7fe8-62a6-4df5-90fb-465116c226a3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.671513] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-c49f7fe8-62a6-4df5-90fb-465116c226a3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.671630] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('c49f7fe8-62a6-4df5-90fb-465116c226a3',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.672410] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-4ec74abc-987a-4435-8c42-e7e606ef3293 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.672531] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-4ec74abc-987a-4435-8c42-e7e606ef3293" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.672592] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-4ec74abc-987a-4435-8c42-e7e606ef3293" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.672819] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-4ec74abc-987a-4435-8c42-e7e606ef3293" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.673010] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('4ec74abc-987a-4435-8c42-e7e606ef3293',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.673948] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.674063] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.674120] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.674364] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.674492] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.675346] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a300461d-04cc-44a3-bc50-afbfc1076857 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.675461] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a300461d-04cc-44a3-bc50-afbfc1076857" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.675527] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a300461d-04cc-44a3-bc50-afbfc1076857" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.675676] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a300461d-04cc-44a3-bc50-afbfc1076857" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.675748] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a300461d-04cc-44a3-bc50-afbfc1076857',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.676577] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-78b18c8a-dfa7-43b1-860f-15a4c0e0a93f taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.676683] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-78b18c8a-dfa7-43b1-860f-15a4c0e0a93f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.676736] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-78b18c8a-dfa7-43b1-860f-15a4c0e0a93f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.676878] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-78b18c8a-dfa7-43b1-860f-15a4c0e0a93f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.676952] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('78b18c8a-dfa7-43b1-860f-15a4c0e0a93f',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.677697] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-018c19d8-0b0e-41bd-8f01-0c9c58710c57 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.677770] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.677853] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.678015] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.678094] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('018c19d8-0b0e-41bd-8f01-0c9c58710c57',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.678871] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-a685dbf9-8823-4364-9677-e8aff5bd2a59 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.678976] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.679064] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.679213] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.679287] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('a685dbf9-8823-4364-9677-e8aff5bd2a59',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.679951] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-2bc6c42e-23db-4008-8db7-e57d76593898 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.680073] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-2bc6c42e-23db-4008-8db7-e57d76593898" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.680139] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-2bc6c42e-23db-4008-8db7-e57d76593898" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.680286] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-2bc6c42e-23db-4008-8db7-e57d76593898" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.680359] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('2bc6c42e-23db-4008-8db7-e57d76593898',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.681047] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-34b6178d-c850-4655-81a1-f452d6a6f576 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.681156] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-34b6178d-c850-4655-81a1-f452d6a6f576" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.681221] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-34b6178d-c850-4655-81a1-f452d6a6f576" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.681368] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-34b6178d-c850-4655-81a1-f452d6a6f576" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.681459] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('34b6178d-c850-4655-81a1-f452d6a6f576',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.682634] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-7e9a1130-f6aa-45df-b627-3bebf6cbd9ff taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.682634] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-7e9a1130-f6aa-45df-b627-3bebf6cbd9ff" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.682826] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-7e9a1130-f6aa-45df-b627-3bebf6cbd9ff" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.682903] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-7e9a1130-f6aa-45df-b627-3bebf6cbd9ff" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.682986] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('7e9a1130-f6aa-45df-b627-3bebf6cbd9ff',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.683790] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.684336] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.684465] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.685428] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.685561] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.686982] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.687132] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.687917] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.688151] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.688237] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.688936] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-5d6b6e19-f017-4eac-b0ac-ed1b17230d12 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.689053] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-5d6b6e19-f017-4eac-b0ac-ed1b17230d12" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.689121] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-5d6b6e19-f017-4eac-b0ac-ed1b17230d12" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.689283] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-5d6b6e19-f017-4eac-b0ac-ed1b17230d12" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.689371] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('5d6b6e19-f017-4eac-b0ac-ed1b17230d12',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.690170] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8e58d7c4-605c-4710-b582-c6c0d7f52ed3 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.690276] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8e58d7c4-605c-4710-b582-c6c0d7f52ed3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.690343] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8e58d7c4-605c-4710-b582-c6c0d7f52ed3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.690487] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8e58d7c4-605c-4710-b582-c6c0d7f52ed3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.690562] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8e58d7c4-605c-4710-b582-c6c0d7f52ed3',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.691344] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-6745d4e2-6069-4132-80d9-76cf2245b017 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.691344] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-6745d4e2-6069-4132-80d9-76cf2245b017" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.691498] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-6745d4e2-6069-4132-80d9-76cf2245b017" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.691583] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-6745d4e2-6069-4132-80d9-76cf2245b017" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.691676] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('6745d4e2-6069-4132-80d9-76cf2245b017',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.692292] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-280210af-8e3d-42c9-8854-42bd856b9dbe taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.692406] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.692472] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.692618] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.692708] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('280210af-8e3d-42c9-8854-42bd856b9dbe',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.693493] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-529c6563-9354-49e2-8282-acd28e0b0ef7 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.693598] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-529c6563-9354-49e2-8282-acd28e0b0ef7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.693664] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-529c6563-9354-49e2-8282-acd28e0b0ef7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.693810] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-529c6563-9354-49e2-8282-acd28e0b0ef7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.693874] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('529c6563-9354-49e2-8282-acd28e0b0ef7',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1270.727574] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.727757] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.727826] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.727973] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.729706] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.729838] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.750624] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.750799] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 4ec74abc-987a-4435-8c42-e7e606ef3293 is going to be deleted. [ 1270.751722] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.752061] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.773302] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.773472] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7516d25f-7616-41dc-9575-16a9cddc1840 is going to be deleted. [ 1270.820626] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.820846] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.820846] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.821059] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.821205] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.821257] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-4ec74abc-987a-4435-8c42-e7e606ef3293" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.850325] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1270.850546] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1270.850546] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1270.850768] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1270.850863] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1270.850982] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7516d25f-7616-41dc-9575-16a9cddc1840" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.202086] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-018c19d8-0b0e-41bd-8f01-0c9c58710c57 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.202229] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.202315] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.202551] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.202709] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.202811] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.202872] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.203049] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.203133] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.203230] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.203297] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('018c19d8-0b0e-41bd-8f01-0c9c58710c57',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.206360] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.206494] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.206587] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.206789] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.206944] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.207053] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.207116] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.207262] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.207341] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.207440] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.207517] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.213544] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e58d7c4-605c-4710-b582-c6c0d7f52ed3 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.213703] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e58d7c4-605c-4710-b582-c6c0d7f52ed3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.213793] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e58d7c4-605c-4710-b582-c6c0d7f52ed3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.214073] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e58d7c4-605c-4710-b582-c6c0d7f52ed3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.214309] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.214460] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.214543] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.214758] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.214872] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.214992] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e58d7c4-605c-4710-b582-c6c0d7f52ed3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.215134] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8e58d7c4-605c-4710-b582-c6c0d7f52ed3',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.221547] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('018c19d8-0b0e-41bd-8f01-0c9c58710c57',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.225158] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.262996] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.263298] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.263404] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.263635] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.265867] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.266212] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.267664] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.267789] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.273745] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.273869] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.275179] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.275316] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.276754] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.276850] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.277999] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.278270] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.279170] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.279274] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.280189] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.280292] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.284707] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.284825] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.285881] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.286014] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.288073] env[67094]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1271.288649] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.288751] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.290177] env[67094]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1271.290611] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.290806] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.296130] env[67094]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1271.296889] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.296889] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.297668] env[67094]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1271.298225] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.298316] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.299102] env[67094]: WARNING urllib3.connectionpool [-] Connection pool is full, discarding connection: nsxt.osci.c.eu-de-1.cloud.sap. Connection pool size: 10: queue.Full [ 1271.299668] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.299811] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56 is going to be deleted. [ 1271.300909] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.301285] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.354561] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.354699] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a300461d-04cc-44a3-bc50-afbfc1076857 is going to be deleted. [ 1271.355747] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.355977] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.381968] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.382189] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 280210af-8e3d-42c9-8854-42bd856b9dbe is going to be deleted. [ 1271.383121] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.383341] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.428717] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.428895] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 78b18c8a-dfa7-43b1-860f-15a4c0e0a93f is going to be deleted. [ 1271.429843] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.430081] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.431784] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.431942] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.447344] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.447558] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.467945] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.468200] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.473163] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.473327] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 5d6b6e19-f017-4eac-b0ac-ed1b17230d12 is going to be deleted. [ 1271.474353] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.474546] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.532672] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.532850] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 2bc6c42e-23db-4008-8db7-e57d76593898 is going to be deleted. [ 1271.534071] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.534310] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.553556] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.553768] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.601163] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.601350] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 7e9a1130-f6aa-45df-b627-3bebf6cbd9ff is going to be deleted. [ 1271.602573] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.602824] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.655185] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.655366] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 34b6178d-c850-4655-81a1-f452d6a6f576 is going to be deleted. [ 1271.656515] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.658085] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.701893] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.702325] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.703065] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.703204] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.725145] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.725388] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: b61bfa2d-4c26-4a49-a153-4a8fb6153ccd is going to be deleted. [ 1271.726744] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8e58d7c4-605c-4710-b582-c6c0d7f52ed3',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1271.727823] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.728770] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.731737] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 018c19d8-0b0e-41bd-8f01-0c9c58710c57: rpc.has_security_group_logging(os_id): False [ 1271.732818] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9: rpc.has_security_group_logging(os_id): False [ 1271.752373] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.752585] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.760711] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.760920] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.779127] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.779313] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6 is going to be deleted. [ 1271.780518] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.780753] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.804212] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.804481] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.823525] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.823728] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: a685dbf9-8823-4364-9677-e8aff5bd2a59 is going to be deleted. [ 1271.825028] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.825028] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.921501] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.921775] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 6745d4e2-6069-4132-80d9-76cf2245b017 is going to be deleted. [ 1271.922686] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.922901] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1271.926028] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.926191] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.952773] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1271.953010] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1271.985037] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1271.985223] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8c8bcd5f-7602-4632-8046-daa41c621837 is going to be deleted. [ 1271.986183] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1271.986418] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.000518] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.000642] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.016024] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.016251] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.022387] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.022693] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.124691] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.124790] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.126189] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.126407] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: c49f7fe8-62a6-4df5-90fb-465116c226a3 is going to be deleted. [ 1272.127678] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.128017] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.153260] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.154334] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 529c6563-9354-49e2-8282-acd28e0b0ef7 is going to be deleted. [ 1272.154453] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.154649] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.154735] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.154860] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-3a0604b7-5ae1-4b2c-90e7-a3f9b340ef56" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.155027] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.155186] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.155269] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.155378] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a300461d-04cc-44a3-bc50-afbfc1076857" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.156828] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.156828] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.156828] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.156828] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-280210af-8e3d-42c9-8854-42bd856b9dbe" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.156828] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.156828] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.156828] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.157211] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-78b18c8a-dfa7-43b1-860f-15a4c0e0a93f" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.157211] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.157345] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.157429] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.157545] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-2bc6c42e-23db-4008-8db7-e57d76593898" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.157675] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.157815] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.157889] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.158010] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-5d6b6e19-f017-4eac-b0ac-ed1b17230d12" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.158308] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.158308] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.158402] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.158456] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-7e9a1130-f6aa-45df-b627-3bebf6cbd9ff" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.158581] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.158717] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.200211] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.200504] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.200638] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.200688] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.200885] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.200968] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.201078] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 is going to be updated. [ 1272.202622] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.202743] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.230186] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8e58d7c4-605c-4710-b582-c6c0d7f52ed3: rpc.has_security_group_logging(os_id): False [ 1272.251027] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.251487] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.251629] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.251718] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.251938] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.252038] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.252163] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 is going to be updated. [ 1272.253512] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.253766] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.253844] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.253964] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-b61bfa2d-4c26-4a49-a153-4a8fb6153ccd" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.254123] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.254274] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.254355] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.254473] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-1b7b6c38-aff1-47f0-8e0b-c1d6955e14d6" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.255548] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.255709] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.255788] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.255944] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.309500] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.309704] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.313380] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.313495] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.316686] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.316846] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.364557] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.364935] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.365074] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.365121] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.365440] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.365440] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.365651] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8e58d7c4-605c-4710-b582-c6c0d7f52ed3 is going to be updated. [ 1272.366714] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.366906] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.366995] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.367138] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8c8bcd5f-7602-4632-8046-daa41c621837" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.367283] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.367434] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.367513] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.367625] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-34b6178d-c850-4655-81a1-f452d6a6f576" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.367799] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.367950] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.368040] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.368158] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-a685dbf9-8823-4364-9677-e8aff5bd2a59" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.368320] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.368493] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.368550] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.368659] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-6745d4e2-6069-4132-80d9-76cf2245b017" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.369351] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.369574] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.369707] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.369883] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-529c6563-9354-49e2-8282-acd28e0b0ef7" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.370017] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.370179] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.370257] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.370365] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-c49f7fe8-62a6-4df5-90fb-465116c226a3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.370512] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.371054] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.371054] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.384979] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.385154] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.385293] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.385432] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.385581] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.413573] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 in Status: IN_PROGRESS for 2s [ 1272.414454] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 in Status: IN_PROGRESS for 2s [ 1272.502144] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1272.502337] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1272.502380] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1272.502629] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1272.503304] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1272.531127] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8e58d7c4-605c-4710-b582-c6c0d7f52ed3 in Status: IN_PROGRESS for 2s [ 1274.431945] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 in Status: SUCCESS [ 1274.432348] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.432861] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 in Status: SUCCESS [ 1274.433071] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1274.542823] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8e58d7c4-605c-4710-b582-c6c0d7f52ed3 in Status: SUCCESS [ 1274.543204] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8e58d7c4-605c-4710-b582-c6c0d7f52ed3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1275.667707] env[67094]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1275.667987] env[67094]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1279.069214] env[67094]: INFO networking_nsxv3.common.synchronization [req-639ade6a-c3fa-481d-9a70-a35deecf4f97 req-6b88edd0-f53f-4e84-8769-5da377994fc9 tempest-ServerActionsTestOtherA-276518123 tempest-ServerActionsTestOtherA-276518123-project-member] Enqueued Resource ID: 005d1062-21f3-48fc-b7a0-06c9f0fc7843 with Priority: HIGHEST for action security_group_members [ 1279.069485] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 005d1062-21f3-48fc-b7a0-06c9f0fc7843 with Priority: HIGHEST for action security_group_members [ 1279.069692] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-005d1062-21f3-48fc-b7a0-06c9f0fc7843 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.071972] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-005d1062-21f3-48fc-b7a0-06c9f0fc7843" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.071972] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-005d1062-21f3-48fc-b7a0-06c9f0fc7843" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.071972] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-005d1062-21f3-48fc-b7a0-06c9f0fc7843" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.071972] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.071972] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.071972] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.071972] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.071972] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.071972] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('005d1062-21f3-48fc-b7a0-06c9f0fc7843',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1279.573462] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.573630] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.573719] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.573910] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.596146] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.596405] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.596521] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.596577] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.596787] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.596872] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.596959] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 005d1062-21f3-48fc-b7a0-06c9f0fc7843 is going to be updated. [ 1279.627018] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1279.627201] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1279.627250] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1279.627551] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1279.627703] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1279.636855] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 005d1062-21f3-48fc-b7a0-06c9f0fc7843 in Status: IN_PROGRESS for 2s [ 1281.649117] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 005d1062-21f3-48fc-b7a0-06c9f0fc7843 in Status: SUCCESS [ 1281.649494] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 005d1062-21f3-48fc-b7a0-06c9f0fc7843 deletion is rescheduled due to dependency. [ 1281.649494] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-005d1062-21f3-48fc-b7a0-06c9f0fc7843" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1284.070620] env[67094]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1284.071034] env[67094]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1287.181272] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock network-78 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.181651] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "network-78" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.181765] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "network-78" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.182089] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "network-78" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.182357] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.182532] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.182680] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.182908] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.183066] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.183288] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1287.183400] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1287.183617] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1287.183801] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1287.183930] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1287.184053] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1287.184621] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1287.206389] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1287.206587] env[67094]: DEBUG dogpile.cache.region [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1287.206689] env[67094]: DEBUG dogpile.lock [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1287.206865] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "network-78" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.207212] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock port-16bd0d62-83f4-4f8a-998a-5a4e4accb222 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.207386] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "port-16bd0d62-83f4-4f8a-998a-5a4e4accb222" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.207502] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "port-16bd0d62-83f4-4f8a-998a-5a4e4accb222" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.207768] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "port-16bd0d62-83f4-4f8a-998a-5a4e4accb222" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.207909] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16bd0d62-83f4-4f8a-998a-5a4e4accb222',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1287.711249] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.711473] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.711582] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.711908] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.712075] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.712380] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.712565] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.712699] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.712934] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.713085] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.713372] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.713530] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.713643] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.713850] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.713981] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.714175] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Resource: SegmentPort with ID: 16bd0d62-83f4-4f8a-998a-5a4e4accb222 is going to be updated. [ 1287.737823] env[67094]: DEBUG networking_nsxv3.common.locking [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1287.738068] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1287.738168] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1287.738441] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1287.738666] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1287.738891] env[67094]: DEBUG oslo_concurrency.lockutils [None req-895c26f1-156c-4e44-b7d6-9278203cb14e None None] Releasing lock "port-16bd0d62-83f4-4f8a-998a-5a4e4accb222" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.426060] env[67094]: INFO networking_nsxv3.common.synchronization [req-1c4a5c42-e04c-4d0d-8e4f-0b859b5ed705 req-5037771d-b95d-444e-8f5d-a7666151b8a6 service nova] Enqueued Resource ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 with Priority: HIGHEST for action security_group_rules [ 1288.426352] env[67094]: INFO networking_nsxv3.common.synchronization [req-1c4a5c42-e04c-4d0d-8e4f-0b859b5ed705 req-5037771d-b95d-444e-8f5d-a7666151b8a6 service nova] Enqueued Resource ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 with Priority: HIGHEST for action security_group_members [ 1288.426813] env[67094]: INFO networking_nsxv3.common.synchronization [req-1c4a5c42-e04c-4d0d-8e4f-0b859b5ed705 req-5037771d-b95d-444e-8f5d-a7666151b8a6 service nova] Enqueued Resource ID: 16bd0d62-83f4-4f8a-998a-5a4e4accb222 with Priority: HIGHEST for action port [ 1288.427856] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 with Priority: HIGHEST for action security_group_rules [ 1288.427991] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 with Priority: HIGHEST for action security_group_members [ 1288.428109] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 16bd0d62-83f4-4f8a-998a-5a4e4accb222 with Priority: HIGHEST for action port [ 1288.428390] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.428516] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.428585] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.428787] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.428867] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.430197] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.430311] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.430529] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.430673] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.430832] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.430953] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.430997] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.431140] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.431226] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.431353] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.432667] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-16bd0d62-83f4-4f8a-998a-5a4e4accb222 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.432756] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-16bd0d62-83f4-4f8a-998a-5a4e4accb222" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.433291] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-16bd0d62-83f4-4f8a-998a-5a4e4accb222" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.433291] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-16bd0d62-83f4-4f8a-998a-5a4e4accb222" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.433291] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('16bd0d62-83f4-4f8a-998a-5a4e4accb222',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.931055] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.931198] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.933633] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1288.934534] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 16bd0d62-83f4-4f8a-998a-5a4e4accb222 with status ACTIVE [ 1288.934738] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.934861] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.934925] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.935147] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.935238] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.935413] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.935513] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.935590] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.935748] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.935924] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.936010] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.936111] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.936172] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.936309] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.936383] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.936468] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 16bd0d62-83f4-4f8a-998a-5a4e4accb222 is going to be updated. [ 1288.958591] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1288.958727] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1288.958822] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1288.959059] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1288.959200] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1288.959365] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-16bd0d62-83f4-4f8a-998a-5a4e4accb222" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.439479] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1289.941935] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.942261] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.942261] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.942565] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.942743] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.942873] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 is going to be updated. [ 1289.978409] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1289.978638] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1289.978638] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1289.978953] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1289.979327] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1289.988019] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 in Status: IN_PROGRESS for 2s [ 1292.000087] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 in Status: SUCCESS [ 1292.000493] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.000493] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.000689] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.000880] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1292.000995] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1292.001073] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1292.001227] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1292.001308] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.001393] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1292.001485] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1292.503496] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1293.006745] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9: rpc.has_security_group_logging(os_id): False [ 1293.027674] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.027898] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.027898] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.028230] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.028338] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.028682] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.028766] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.028905] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.029158] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.029317] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.029317] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 is going to be updated. [ 1293.096650] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1293.096885] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1293.096885] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1293.097122] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1293.097263] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1293.111808] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 in Status: IN_PROGRESS for 2s [ 1293.429631] env[67094]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1293.429631] env[67094]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1295.129441] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 in Status: SUCCESS [ 1295.129762] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1298.430942] env[67094]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1298.431398] env[67094]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1303.432835] env[67094]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1303.433246] env[67094]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1305.185599] env[67094]: INFO networking_nsxv3.common.synchronization [req-c7de5df5-fcc6-4aa8-b6fa-da1e1c61d5bf req-facc7488-295b-45ce-9d11-947059649269 tempest-ServerActionsTestOtherB-1168296312 tempest-ServerActionsTestOtherB-1168296312-project-member] Enqueued Resource ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 with Priority: HIGHEST for action security_group_members [ 1305.186299] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 with Priority: HIGHEST for action security_group_members [ 1305.186497] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.186608] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.186679] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.186882] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.187046] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.187155] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.187216] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.187341] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.187417] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.187511] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1305.689678] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.689877] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.689952] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.690211] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.690304] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.690506] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.690604] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.690666] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.690815] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.690911] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.690967] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 is going to be updated. [ 1305.731423] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1305.731423] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1305.731621] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1305.731687] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1305.731850] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1305.741967] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 in Status: IN_PROGRESS for 2s [ 1307.753833] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 in Status: SUCCESS [ 1307.754168] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9 deletion is rescheduled due to dependency. [ 1307.754168] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-0f93ce30-11bd-4b1c-be9f-ff5aa020f4c9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1310.188126] env[67094]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1310.188126] env[67094]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1313.718534] env[67094]: INFO networking_nsxv3.common.synchronization [req-ec9710fb-5223-4234-a377-70c0dd2a68e1 req-9236b8ff-2047-45ae-8217-5ad4ed935a4c tempest-AttachVolumeNegativeTest-737516548 tempest-AttachVolumeNegativeTest-737516548-project-member] Enqueued Resource ID: b246490e-f4de-45f5-ba36-79df6a6e88f9 with Priority: HIGHEST for action security_group_members [ 1313.719473] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: b246490e-f4de-45f5-ba36-79df6a6e88f9 with Priority: HIGHEST for action security_group_members [ 1313.719473] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-b246490e-f4de-45f5-ba36-79df6a6e88f9 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.719704] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-b246490e-f4de-45f5-ba36-79df6a6e88f9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.719704] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-b246490e-f4de-45f5-ba36-79df6a6e88f9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.719998] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-b246490e-f4de-45f5-ba36-79df6a6e88f9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.719998] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1313.719998] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1313.720147] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1313.720258] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1313.720307] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1313.720424] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('b246490e-f4de-45f5-ba36-79df6a6e88f9',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1314.224528] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.224776] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.224776] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.224893] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.256174] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.256487] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.256660] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.256760] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.257009] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.257145] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.257265] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b246490e-f4de-45f5-ba36-79df6a6e88f9 is going to be updated. [ 1314.289793] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1314.290050] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1314.290101] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1314.290341] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1314.290490] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1314.302177] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b246490e-f4de-45f5-ba36-79df6a6e88f9 in Status: IN_PROGRESS for 2s [ 1316.318727] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: b246490e-f4de-45f5-ba36-79df6a6e88f9 in Status: SUCCESS [ 1316.319201] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: b246490e-f4de-45f5-ba36-79df6a6e88f9 deletion is rescheduled due to dependency. [ 1316.319582] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-b246490e-f4de-45f5-ba36-79df6a6e88f9" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1317.784939] env[67094]: INFO networking_nsxv3.common.synchronization [None req-65dd796b-9a5a-476e-9095-545049b64972 tempest-AttachVolumeNegativeTest-737516548 tempest-AttachVolumeNegativeTest-737516548-project-member] Enqueued Resource ID: 862ad768-c053-4b2f-82d0-6be7e092155d with Priority: HIGHEST for action security_group_rules [ 1317.785579] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 862ad768-c053-4b2f-82d0-6be7e092155d with Priority: HIGHEST for action security_group_rules [ 1317.785937] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-862ad768-c053-4b2f-82d0-6be7e092155d taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.786220] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-862ad768-c053-4b2f-82d0-6be7e092155d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1317.786293] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-862ad768-c053-4b2f-82d0-6be7e092155d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1317.786554] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-862ad768-c053-4b2f-82d0-6be7e092155d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1317.786637] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('862ad768-c053-4b2f-82d0-6be7e092155d',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1317.864987] env[67094]: INFO networking_nsxv3.common.synchronization [None req-eee85ce1-c35d-4e02-8030-d3c57a205e5a tempest-AttachVolumeNegativeTest-737516548 tempest-AttachVolumeNegativeTest-737516548-project-member] Enqueued Resource ID: 862ad768-c053-4b2f-82d0-6be7e092155d with Priority: HIGHEST for action security_group_rules [ 1317.865353] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 862ad768-c053-4b2f-82d0-6be7e092155d with Priority: HIGHEST for action security_group_rules [ 1317.865662] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-862ad768-c053-4b2f-82d0-6be7e092155d taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1317.865766] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-862ad768-c053-4b2f-82d0-6be7e092155d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.313542] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.313788] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.313788] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.313967] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.314131] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.314217] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 862ad768-c053-4b2f-82d0-6be7e092155d already deleted. [ 1318.314285] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-862ad768-c053-4b2f-82d0-6be7e092155d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.314465] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-862ad768-c053-4b2f-82d0-6be7e092155d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.314644] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-862ad768-c053-4b2f-82d0-6be7e092155d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.314725] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('862ad768-c053-4b2f-82d0-6be7e092155d',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1318.836127] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1318.836529] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1318.836529] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1318.836629] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1318.836629] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1318.836717] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 862ad768-c053-4b2f-82d0-6be7e092155d already deleted. [ 1318.836790] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-862ad768-c053-4b2f-82d0-6be7e092155d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.920683] env[67094]: INFO networking_nsxv3.common.synchronization [req-2f4d39e0-ebc3-4da7-90b6-58e4e2582920 req-07c93ece-ae67-4e7f-9312-359c63ceab8e tempest-ServerActionsTestJSON-785713127 tempest-ServerActionsTestJSON-785713127-project-member] Enqueued Resource ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 with Priority: HIGHEST for action security_group_members [ 1321.920683] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 with Priority: HIGHEST for action security_group_members [ 1321.920996] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-018c19d8-0b0e-41bd-8f01-0c9c58710c57 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.920996] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.921186] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.921414] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.921587] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1321.921686] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1321.921788] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1321.922103] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1321.922103] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1321.922186] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('018c19d8-0b0e-41bd-8f01-0c9c58710c57',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1322.425061] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.425061] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.425061] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.425291] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.425461] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.425589] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.425973] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.425973] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.425973] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.426141] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.426141] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 is going to be updated. [ 1322.462318] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1322.462499] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1322.462542] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1322.462735] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1322.462907] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1322.474318] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 in Status: IN_PROGRESS for 2s [ 1323.333408] env[67094]: INFO networking_nsxv3.common.synchronization [req-a3f793cf-d2c1-4021-b855-0a54d29f3aa2 req-24d2c9f3-c2a1-4334-8b60-41064e919cd6 tempest-AttachVolumeNegativeTest-737516548 tempest-AttachVolumeNegativeTest-737516548-project-member] Enqueued Resource ID: 862ad768-c053-4b2f-82d0-6be7e092155d with Priority: HIGHEST for action security_group_members [ 1323.333816] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 862ad768-c053-4b2f-82d0-6be7e092155d with Priority: HIGHEST for action security_group_members [ 1323.334217] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-862ad768-c053-4b2f-82d0-6be7e092155d taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.334373] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-862ad768-c053-4b2f-82d0-6be7e092155d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.334373] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-862ad768-c053-4b2f-82d0-6be7e092155d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.334613] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-862ad768-c053-4b2f-82d0-6be7e092155d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.334768] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.334901] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.334979] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.335122] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.335233] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.335335] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('862ad768-c053-4b2f-82d0-6be7e092155d',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1323.624583] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock network-871 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.624820] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "network-871" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.624958] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "network-871" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.625291] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "network-871" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.625738] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.625858] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.625907] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.626181] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.626344] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.626579] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1323.626715] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1323.626846] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1323.626967] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1323.627145] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1323.627293] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1323.627419] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1323.648927] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1323.649123] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Cache value generated in 0.022 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1323.649242] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1323.649411] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "network-871" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.649742] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock port-cc035505-3ed6-4776-ac63-ad9cda492031 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.649944] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "port-cc035505-3ed6-4776-ac63-ad9cda492031" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.650084] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "port-cc035505-3ed6-4776-ac63-ad9cda492031" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.650404] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "port-cc035505-3ed6-4776-ac63-ad9cda492031" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.650543] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc035505-3ed6-4776-ac63-ad9cda492031',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1323.837785] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.838049] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.838049] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.838293] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.838408] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.838610] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1323.838716] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1323.838780] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1323.838943] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1323.839033] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1323.839119] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 862ad768-c053-4b2f-82d0-6be7e092155d already deleted. [ 1323.839201] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-862ad768-c053-4b2f-82d0-6be7e092155d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.153371] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.153716] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.153775] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.154188] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.154442] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.154655] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Segment Port cc035505-3ed6-4776-ac63-ad9cda492031 not found, creating... [ 1324.154976] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.155241] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.155371] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.155973] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.155973] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.156580] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.156580] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.156580] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.156883] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.157255] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.157255] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Resource: SegmentPort with ID: cc035505-3ed6-4776-ac63-ad9cda492031 is going to be created. [ 1324.180121] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.180346] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.180474] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.180757] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.181023] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.181265] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "port-cc035505-3ed6-4776-ac63-ad9cda492031" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.485822] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 in Status: SUCCESS [ 1324.486246] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 018c19d8-0b0e-41bd-8f01-0c9c58710c57 deletion is rescheduled due to dependency. [ 1324.486246] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-018c19d8-0b0e-41bd-8f01-0c9c58710c57" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.878220] env[67094]: INFO networking_nsxv3.common.synchronization [req-a3f793cf-d2c1-4021-b855-0a54d29f3aa2 req-2404e290-7129-47bc-a7cc-0764e2e1e543 service nova] Enqueued Resource ID: 862ad768-c053-4b2f-82d0-6be7e092155d with Priority: HIGHEST for action security_group_rules [ 1324.878220] env[67094]: INFO networking_nsxv3.common.synchronization [req-a3f793cf-d2c1-4021-b855-0a54d29f3aa2 req-2404e290-7129-47bc-a7cc-0764e2e1e543 service nova] Enqueued Resource ID: 862ad768-c053-4b2f-82d0-6be7e092155d with Priority: HIGHEST for action security_group_members [ 1324.878220] env[67094]: INFO networking_nsxv3.common.synchronization [req-a3f793cf-d2c1-4021-b855-0a54d29f3aa2 req-2404e290-7129-47bc-a7cc-0764e2e1e543 service nova] Enqueued Resource ID: cc035505-3ed6-4776-ac63-ad9cda492031 with Priority: HIGHEST for action port [ 1324.878220] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 862ad768-c053-4b2f-82d0-6be7e092155d with Priority: HIGHEST for action security_group_rules [ 1324.878521] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 862ad768-c053-4b2f-82d0-6be7e092155d with Priority: HIGHEST for action security_group_members [ 1324.878804] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: cc035505-3ed6-4776-ac63-ad9cda492031 with Priority: HIGHEST for action port [ 1324.879200] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-862ad768-c053-4b2f-82d0-6be7e092155d taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.879440] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-862ad768-c053-4b2f-82d0-6be7e092155d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.879622] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-862ad768-c053-4b2f-82d0-6be7e092155d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.880028] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-862ad768-c053-4b2f-82d0-6be7e092155d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.880212] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('862ad768-c053-4b2f-82d0-6be7e092155d',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1324.881134] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-862ad768-c053-4b2f-82d0-6be7e092155d taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.881461] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-862ad768-c053-4b2f-82d0-6be7e092155d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.881635] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-862ad768-c053-4b2f-82d0-6be7e092155d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.881921] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-862ad768-c053-4b2f-82d0-6be7e092155d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.882195] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.882433] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.882590] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.882875] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.883870] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1324.883870] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('862ad768-c053-4b2f-82d0-6be7e092155d',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1324.884305] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-cc035505-3ed6-4776-ac63-ad9cda492031 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1324.884408] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-cc035505-3ed6-4776-ac63-ad9cda492031" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1324.884470] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-cc035505-3ed6-4776-ac63-ad9cda492031" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1324.884620] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-cc035505-3ed6-4776-ac63-ad9cda492031" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1324.884715] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('cc035505-3ed6-4776-ac63-ad9cda492031',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1325.386706] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-862ad768-c053-4b2f-82d0-6be7e092155d taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.386851] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-862ad768-c053-4b2f-82d0-6be7e092155d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.387081] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('862ad768-c053-4b2f-82d0-6be7e092155d',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1325.387962] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port cc035505-3ed6-4776-ac63-ad9cda492031 with status ACTIVE [ 1325.388165] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.388295] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.388362] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.388558] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.388662] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.388871] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.388950] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.388985] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.389146] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.389224] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.389398] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.389490] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.389550] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.389686] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.389758] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.389876] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: cc035505-3ed6-4776-ac63-ad9cda492031 is going to be updated. [ 1325.415845] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1325.416094] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1325.416094] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1325.416244] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1325.416358] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.416513] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-cc035505-3ed6-4776-ac63-ad9cda492031" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1325.892266] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('862ad768-c053-4b2f-82d0-6be7e092155d',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1326.394985] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.395223] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.395271] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.395458] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.395548] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.395647] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 862ad768-c053-4b2f-82d0-6be7e092155d is going to be created. [ 1326.431268] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1326.431541] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1326.431663] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1326.431967] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1326.432183] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1326.454235] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 862ad768-c053-4b2f-82d0-6be7e092155d in Status: UNINITIALIZED for 2s [ 1328.466039] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 862ad768-c053-4b2f-82d0-6be7e092155d in Status: SUCCESS [ 1328.466402] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-862ad768-c053-4b2f-82d0-6be7e092155d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.466451] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-862ad768-c053-4b2f-82d0-6be7e092155d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.466654] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-862ad768-c053-4b2f-82d0-6be7e092155d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.466848] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1328.467151] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1328.467151] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1328.467301] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1328.467301] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.467369] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-862ad768-c053-4b2f-82d0-6be7e092155d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1328.467427] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('862ad768-c053-4b2f-82d0-6be7e092155d',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1328.970403] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('862ad768-c053-4b2f-82d0-6be7e092155d',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1329.472457] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 862ad768-c053-4b2f-82d0-6be7e092155d: rpc.has_security_group_logging(os_id): False [ 1329.493373] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.493675] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.493675] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.493775] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.493869] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.494120] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.494219] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.494282] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.494436] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.494511] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.494592] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 862ad768-c053-4b2f-82d0-6be7e092155d is going to be created. [ 1329.567748] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1329.567985] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1329.567985] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1329.568190] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1329.568425] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1329.582568] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 862ad768-c053-4b2f-82d0-6be7e092155d in Status: IN_PROGRESS for 2s [ 1329.880440] env[67094]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1329.880544] env[67094]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1331.595804] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 862ad768-c053-4b2f-82d0-6be7e092155d in Status: SUCCESS [ 1331.596233] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-862ad768-c053-4b2f-82d0-6be7e092155d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.317588] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock network-787 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.317798] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "network-787" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.317916] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "network-787" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.318257] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "network-787" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.318972] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.319271] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.319478] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.319719] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.319899] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.320145] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1332.320259] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] NeedRegenerationException {{(pid=67094) _enter /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:90}} [ 1332.320369] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] no value, waiting for create lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:131}} [ 1332.320475] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] value creation lock acquired {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:135}} [ 1332.320583] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] No value present for key: 'zone-id' {{(pid=67094) _is_cache_miss /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:918}} [ 1332.320694] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Calling creation function for not-yet-present value {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:174}} [ 1332.320831] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Looking for TransportZone with name nsx-vlan-transportzone. [ 1332.344316] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] loading zone with a95c914d-748d-497c-94ab-10d4647daeba and tags [{'scope': 'mp2policy_migr_status', 'tag': 'success'}] [ 1332.344503] env[67094]: DEBUG dogpile.cache.region [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Cache value generated in 0.024 seconds for key(s): 'zone-id' {{(pid=67094) _log_time /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/cache/region.py:910}} [ 1332.344622] env[67094]: DEBUG dogpile.lock [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Released creation lock {{(pid=67094) _enter_create /opt/stack/data/venv/lib/python3.10/site-packages/dogpile/lock.py:182}} [ 1332.344789] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "network-787" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.345128] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock port-166fe62f-8064-44cf-b347-a266959cf3b4 taken with stack trace [, , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.345305] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "port-166fe62f-8064-44cf-b347-a266959cf3b4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.345426] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "port-166fe62f-8064-44cf-b347-a266959cf3b4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.345691] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "port-166fe62f-8064-44cf-b347-a266959cf3b4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.345829] env[67094]: DEBUG networking_nsxv3.api.rpc [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('166fe62f-8064-44cf-b347-a266959cf3b4',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1332.848209] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.848609] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.848675] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.849120] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.849378] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.849851] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock Segment taken with stack trace [, , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.850130] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.850330] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.850596] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.850746] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.851117] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.851292] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.851410] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.851624] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.851756] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.851928] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Resource: SegmentPort with ID: 166fe62f-8064-44cf-b347-a266959cf3b4 is going to be updated. [ 1332.875721] env[67094]: DEBUG networking_nsxv3.common.locking [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Lock SegmentPort taken with stack trace [, , , , , , , , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1332.875953] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1332.876080] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1332.876354] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1332.876555] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1332.876769] env[67094]: DEBUG oslo_concurrency.lockutils [None req-24cefd65-c944-44ad-9de4-43241f63a653 None None] Releasing lock "port-166fe62f-8064-44cf-b347-a266959cf3b4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.645112] env[67094]: INFO networking_nsxv3.common.synchronization [req-4ee7f2c4-0564-4438-bd2a-cf38c1548401 req-d7ffb4cf-6cb2-4215-8016-4ff53f6a888a service nova] Enqueued Resource ID: 8e58d7c4-605c-4710-b582-c6c0d7f52ed3 with Priority: HIGHEST for action security_group_rules [ 1333.645309] env[67094]: INFO networking_nsxv3.common.synchronization [req-4ee7f2c4-0564-4438-bd2a-cf38c1548401 req-d7ffb4cf-6cb2-4215-8016-4ff53f6a888a service nova] Enqueued Resource ID: 8e58d7c4-605c-4710-b582-c6c0d7f52ed3 with Priority: HIGHEST for action security_group_members [ 1333.645629] env[67094]: INFO networking_nsxv3.common.synchronization [req-4ee7f2c4-0564-4438-bd2a-cf38c1548401 req-d7ffb4cf-6cb2-4215-8016-4ff53f6a888a service nova] Enqueued Resource ID: 166fe62f-8064-44cf-b347-a266959cf3b4 with Priority: HIGHEST for action port [ 1333.645995] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e58d7c4-605c-4710-b582-c6c0d7f52ed3 with Priority: HIGHEST for action security_group_rules [ 1333.646131] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e58d7c4-605c-4710-b582-c6c0d7f52ed3 with Priority: HIGHEST for action security_group_members [ 1333.646231] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 166fe62f-8064-44cf-b347-a266959cf3b4 with Priority: HIGHEST for action port [ 1333.646505] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock rules-8e58d7c4-605c-4710-b582-c6c0d7f52ed3 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.646629] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "rules-8e58d7c4-605c-4710-b582-c6c0d7f52ed3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.646736] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "rules-8e58d7c4-605c-4710-b582-c6c0d7f52ed3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.646898] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "rules-8e58d7c4-605c-4710-b582-c6c0d7f52ed3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.646981] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group called with arguments ('8e58d7c4-605c-4710-b582-c6c0d7f52ed3',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1333.648844] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e58d7c4-605c-4710-b582-c6c0d7f52ed3 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.649082] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e58d7c4-605c-4710-b582-c6c0d7f52ed3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.649171] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e58d7c4-605c-4710-b582-c6c0d7f52ed3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.649363] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e58d7c4-605c-4710-b582-c6c0d7f52ed3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.649514] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.649615] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.649676] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.649820] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.649913] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1333.650021] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e58d7c4-605c-4710-b582-c6c0d7f52ed3',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1333.651603] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock port-166fe62f-8064-44cf-b347-a266959cf3b4 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1333.651711] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "port-166fe62f-8064-44cf-b347-a266959cf3b4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1333.652729] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "port-166fe62f-8064-44cf-b347-a266959cf3b4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1333.652729] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "port-166fe62f-8064-44cf-b347-a266959cf3b4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1333.652872] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_port called with arguments ('166fe62f-8064-44cf-b347-a266959cf3b4',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1334.150204] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e58d7c4-605c-4710-b582-c6c0d7f52ed3 taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.150619] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e58d7c4-605c-4710-b582-c6c0d7f52ed3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.151621] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_members_effective_ips called with arguments ('8e58d7c4-605c-4710-b582-c6c0d7f52ed3',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1334.155689] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] realization of port 166fe62f-8064-44cf-b347-a266959cf3b4 with status ACTIVE [ 1334.155689] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.155689] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.155689] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.155689] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.155689] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.155689] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Segment taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.155689] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.155689] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.155689] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.155689] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Segment" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.155689] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.156310] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.156310] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.156310] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.156310] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.156310] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: SegmentPort with ID: 166fe62f-8064-44cf-b347-a266959cf3b4 is going to be updated. [ 1334.178208] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock SegmentPort taken with stack trace [, , , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1334.178427] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1334.178427] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1334.178603] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1334.178737] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "SegmentPort" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.178892] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "port-166fe62f-8064-44cf-b347-a266959cf3b4" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1334.653637] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_security_group_port_ids called with arguments ('8e58d7c4-605c-4710-b582-c6c0d7f52ed3',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1335.157104] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.157522] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.157522] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.157522] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.157632] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.157673] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e58d7c4-605c-4710-b582-c6c0d7f52ed3 is going to be updated. [ 1335.190710] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1335.190931] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1335.190931] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1335.191130] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1335.191277] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1335.201899] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e58d7c4-605c-4710-b582-c6c0d7f52ed3 in Status: IN_PROGRESS for 2s [ 1337.217137] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e58d7c4-605c-4710-b582-c6c0d7f52ed3 in Status: SUCCESS [ 1337.217603] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e58d7c4-605c-4710-b582-c6c0d7f52ed3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.217603] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e58d7c4-605c-4710-b582-c6c0d7f52ed3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.217708] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e58d7c4-605c-4710-b582-c6c0d7f52ed3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.217823] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1337.217929] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1337.217992] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1337.218161] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1337.218243] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.218331] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e58d7c4-605c-4710-b582-c6c0d7f52ed3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1337.218422] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method get_rules_for_security_group_id called with arguments ('8e58d7c4-605c-4710-b582-c6c0d7f52ed3',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1337.721070] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_logging called with arguments ('8e58d7c4-605c-4710-b582-c6c0d7f52ed3',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1338.223427] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.realization [-] Neutron DB logged flag for 8e58d7c4-605c-4710-b582-c6c0d7f52ed3: rpc.has_security_group_logging(os_id): False [ 1338.251999] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.252252] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.252330] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.252492] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.252574] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.252863] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.252991] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.253053] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.253223] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.253302] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.253391] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Rules) with ID: 8e58d7c4-605c-4710-b582-c6c0d7f52ed3 is going to be updated. [ 1338.323461] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1338.323706] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1338.323785] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1338.324070] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1338.324254] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1338.342601] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8e58d7c4-605c-4710-b582-c6c0d7f52ed3 in Status: IN_PROGRESS for 2s [ 1338.647148] env[67094]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1338.647392] env[67094]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=1 [ 1340.361813] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Rules) ID: 8e58d7c4-605c-4710-b582-c6c0d7f52ed3 in Status: SUCCESS [ 1340.362175] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "rules-8e58d7c4-605c-4710-b582-c6c0d7f52ed3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1343.648270] env[67094]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1343.648644] env[67094]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1348.650398] env[67094]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1348.650905] env[67094]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1353.652202] env[67094]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1353.652607] env[67094]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1358.653420] env[67094]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1358.653420] env[67094]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1363.654457] env[67094]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1363.654917] env[67094]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1368.655433] env[67094]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1368.655807] env[67094]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1373.657304] env[67094]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1373.657731] env[67094]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1378.658266] env[67094]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1378.658676] env[67094]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1383.659847] env[67094]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1383.659847] env[67094]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1388.279296] env[67094]: INFO networking_nsxv3.common.synchronization [req-c2f105a2-e762-41fc-a3ff-3cda049811e3 req-ac2257ae-3687-4105-b795-c7d7756c9398 tempest-AttachVolumeShelveTestJSON-2030912383 tempest-AttachVolumeShelveTestJSON-2030912383-project-member] Enqueued Resource ID: 8e58d7c4-605c-4710-b582-c6c0d7f52ed3 with Priority: HIGHEST for action security_group_members [ 1388.279861] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 8e58d7c4-605c-4710-b582-c6c0d7f52ed3 with Priority: HIGHEST for action security_group_members [ 1388.280201] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-8e58d7c4-605c-4710-b582-c6c0d7f52ed3 taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.280364] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-8e58d7c4-605c-4710-b582-c6c0d7f52ed3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.280465] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-8e58d7c4-605c-4710-b582-c6c0d7f52ed3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.280681] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-8e58d7c4-605c-4710-b582-c6c0d7f52ed3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.280838] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.280935] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.280993] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.281152] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.281237] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.281328] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('8e58d7c4-605c-4710-b582-c6c0d7f52ed3',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1388.783561] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.783801] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.783883] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.784130] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.784272] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.784534] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.784688] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.784790] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.785058] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.785191] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.785311] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e58d7c4-605c-4710-b582-c6c0d7f52ed3 is going to be updated. [ 1388.819972] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.820264] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.820363] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.820581] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.820729] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.824081] env[67094]: INFO networking_nsxv3.common.synchronization [req-73c7f1e9-767e-4261-b1b1-3c9c44a1258e req-f16374bc-68e8-4860-b395-8bcd7ab2b83d tempest-AttachVolumeNegativeTest-737516548 tempest-AttachVolumeNegativeTest-737516548-project-member] Enqueued Resource ID: 862ad768-c053-4b2f-82d0-6be7e092155d with Priority: HIGHEST for action security_group_members [ 1388.824865] env[67094]: INFO networking_nsxv3.common.synchronization [-] Processing Resource ID: 862ad768-c053-4b2f-82d0-6be7e092155d with Priority: HIGHEST for action security_group_members [ 1388.825505] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock member-862ad768-c053-4b2f-82d0-6be7e092155d taken with stack trace [, , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.825637] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "member-862ad768-c053-4b2f-82d0-6be7e092155d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.825711] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "member-862ad768-c053-4b2f-82d0-6be7e092155d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.825866] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "member-862ad768-c053-4b2f-82d0-6be7e092155d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.826019] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1388.826117] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1388.826177] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1388.826419] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1388.826498] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1388.826594] env[67094]: DEBUG networking_nsxv3.api.rpc [-] networking_nsxv3.api.rpc.NSXv3ServerRpcApi method has_security_group_used_by_host called with arguments ('862ad768-c053-4b2f-82d0-6be7e092155d',) {} {{(pid=67094) wrapper /opt/stack/data/venv/lib/python3.10/site-packages/oslo_log/helpers.py:65}} [ 1388.849224] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e58d7c4-605c-4710-b582-c6c0d7f52ed3 in Status: IN_PROGRESS for 2s [ 1389.328697] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Rules) taken with stack trace [, , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.329199] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.329199] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.329199] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.329310] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Rules)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.329420] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.329515] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.329577] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.329730] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.329807] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.329891] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 862ad768-c053-4b2f-82d0-6be7e092155d is going to be updated. [ 1389.357755] env[67094]: DEBUG networking_nsxv3.common.locking [-] Lock Security Group (Members) taken with stack trace [, , , , , , ] {{(pid=67094) get_lock /opt/stack/networking-nsx-t/networking_nsxv3/common/locking.py:46}} [ 1389.357968] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}} [ 1389.358029] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}} [ 1389.358205] env[67094]: DEBUG oslo_concurrency.lockutils [-] Acquired external semaphore "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:324}} [ 1389.358344] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "Security Group (Members)" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1389.375456] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 862ad768-c053-4b2f-82d0-6be7e092155d in Status: IN_PROGRESS for 2s [ 1390.860989] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 8e58d7c4-605c-4710-b582-c6c0d7f52ed3 in Status: SUCCESS [ 1390.861531] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 8e58d7c4-605c-4710-b582-c6c0d7f52ed3 deletion is rescheduled due to dependency. [ 1390.861531] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-8e58d7c4-605c-4710-b582-c6c0d7f52ed3" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1391.388341] env[67094]: INFO networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Security Group (Members) ID: 862ad768-c053-4b2f-82d0-6be7e092155d in Status: SUCCESS [ 1391.388527] env[67094]: WARNING networking_nsxv3.plugins.ml2.drivers.nsxv3.agent.provider_nsx_policy [-] Resource: Security Group (Members) with ID: 862ad768-c053-4b2f-82d0-6be7e092155d deletion is rescheduled due to dependency. [ 1391.388644] env[67094]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "member-862ad768-c053-4b2f-82d0-6be7e092155d" {{(pid=67094) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}} [ 1393.825415] env[67094]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1393.825784] env[67094]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1398.827234] env[67094]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1398.827596] env[67094]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1403.828449] env[67094]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1403.828826] env[67094]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1408.829957] env[67094]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1408.830420] env[67094]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1413.831736] env[67094]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1413.832225] env[67094]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1418.833082] env[67094]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1418.833082] env[67094]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1423.834299] env[67094]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1423.834677] env[67094]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0 [ 1428.835383] env[67094]: INFO networking_nsxv3.common.synchronization [-] No activity for the last 5 seconds. [ 1428.835758] env[67094]: INFO networking_nsxv3.common.synchronization [-] Sizes Queue[Active=0, Passive=0], Jobs=0